-- Logs begin at Wed 2022-08-03 10:00:16 UTC, end at Wed 2022-08-03 11:05:18 UTC. -- Aug 03 10:34:46.527395 dv-cinder-850836-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 10:34:46.536862 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 10:34:46.539055 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 10:34:46 2022] *** Aug 03 10:34:46.539055 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 10:34:46.539055 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 10:34:46.539055 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: nodename: dv-cinder-850836-2-iscsi Aug 03 10:34:46.539055 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: machine: x86_64 Aug 03 10:34:46.539055 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: clock source: unix Aug 03 10:34:46.539055 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: pcre jit disabled Aug 03 10:34:46.539055 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: detected number of CPU cores: 4 Aug 03 10:34:46.539055 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: current working directory: / Aug 03 10:34:46.539055 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: detected binary path: /usr/bin/uwsgi-core Aug 03 10:34:46.539055 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: your processes number limit is 47680 Aug 03 10:34:46.539055 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: your memory page size is 4096 bytes Aug 03 10:34:46.539055 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: detected max file descriptor number: 2048 Aug 03 10:34:46.539055 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: lock engine: pthread robust mutexes Aug 03 10:34:46.539997 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: thunder lock: enabled Aug 03 10:34:46.539997 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 10:34:46.539997 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 10:34:46.587138 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: Python main interpreter initialized at 0x55ce334389c0 Aug 03 10:34:46.587138 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: python threads support enabled Aug 03 10:34:46.587138 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: your server socket listen backlog is limited to 100 connections Aug 03 10:34:46.587138 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: your mercy for graceful operations on workers is 90 seconds Aug 03 10:34:46.587566 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 10:34:46.587566 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: *** Operational MODE: preforking *** Aug 03 10:34:46.587839 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: *** uWSGI is running in multiple interpreter mode *** Aug 03 10:34:46.587839 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: spawned uWSGI master process (pid: 109879) Aug 03 10:34:46.588056 dv-cinder-850836-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 03 10:34:46.591703 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: spawned uWSGI worker 1 (pid: 109880, cores: 1) Aug 03 10:34:46.591703 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: spawned uWSGI worker 2 (pid: 109881, cores: 1) Aug 03 10:34:46.591703 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 10:34:47.255406 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 10:34:47.267949 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 10:34:48.365633 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 10:34:48.365633 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: from cryptography.utils import int_from_bytes Aug 03 10:34:48.366219 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 10:34:48.366219 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: from cryptography.utils import int_from_bytes Aug 03 10:34:48.369566 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 10:34:48.369566 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: from cryptography.utils import int_from_bytes Aug 03 10:34:48.370026 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 10:34:48.370026 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: from cryptography.utils import int_from_bytes Aug 03 10:34:50.905865 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 10:34:50.906474 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 10:34:50.906629 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 10:34:50.906992 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 10:34:50.907239 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 10:34:50.907620 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.907939 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.908254 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.908566 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.908701 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 10:34:50.909087 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 10:34:50.909228 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.909228 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.909500 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 10:34:50.909641 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.909795 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 10:34:50.909927 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.910046 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 10:34:50.910173 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.910377 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.910502 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.910650 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.910772 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.910972 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-2-iscsi {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.911110 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.911287 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.911408 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.911589 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.911717 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.911894 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.912029 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.912214 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.912354 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.912510 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.912636 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.912831 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.912959 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.913086 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.913204 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.913402 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.913626 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.914082 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-2-iscsi {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.914274 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.914437 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.914605 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.914760 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.914955 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.915132 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.915293 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.915473 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.915638 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.915756 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.915955 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.916149 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.916334 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.916463 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.916599 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.916739 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.916895 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.917019 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.917169 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.917313 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.917492 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-2-iscsi {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.917645 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.917793 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.917928 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.918057 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.918196 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.918321 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.918621 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.918751 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.918883 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.919059 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.919188 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.919366 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.919539 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.919677 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.919811 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.919953 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.920106 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-2-iscsi {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.920231 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.920418 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.920583 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.920698 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.921213 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.921892 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.922025 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.922025 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.922258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.922428 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.922544 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.922675 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.922812 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.923015 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.923143 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.923262 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.923393 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.923525 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.923654 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.923772 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.923892 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.924025 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.924144 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.924273 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.924391 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.924509 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.924627 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.924745 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.924863 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.924991 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.925125 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.925244 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.925370 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.925508 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.925644 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.925763 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.925893 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.926025 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.926195 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.926324 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.926524 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.926689 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.926833 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.926980 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.927130 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.927285 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.927436 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.927593 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.927741 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.927911 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.928057 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.928208 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.928208 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.928909 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.929068 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.929219 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.929362 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.929562 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.929562 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.929846 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.929988 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.930129 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.930271 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.930420 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.930420 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.930695 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.930695 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.930980 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.931130 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.931272 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.931412 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.931553 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.931693 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.931834 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.931983 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.932132 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.932280 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.932421 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.932568 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.932707 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.932862 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.933003 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.933170 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.933331 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.933497 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.933642 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.933839 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.934003 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.934146 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.934294 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.934471 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.934725 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.934880 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.935036 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.935177 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.935325 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.935325 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.935661 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.935806 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.935988 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.936140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.936283 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.936423 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.936677 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.936831 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.937680 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.937828 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.937982 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.938155 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.938309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.938450 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.938590 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.938730 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.938894 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.939140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.939292 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.939434 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.939575 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.939720 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.939862 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.940017 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.940160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.940301 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.940443 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.940583 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.940723 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.940876 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.941018 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.941159 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.941302 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.941442 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.941615 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.941770 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.941911 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.942052 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.942199 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.942355 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.942497 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.942651 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.942799 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.942941 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.943081 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.943245 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.943417 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.943580 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.943736 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.943976 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.944121 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.944263 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.944405 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.944555 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.944704 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.944844 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.944992 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.945133 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.945283 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.945439 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.945620 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.945620 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.945890 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.946045 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.946186 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.946341 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.946483 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.946649 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.946810 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.946970 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.947131 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.947273 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.947439 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.947670 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.947863 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.948018 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.948195 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.948339 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.948480 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.948621 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.948761 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.948913 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.949067 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.949303 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.949453 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.949659 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.949802 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.949942 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.950099 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.950241 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.950382 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.950533 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.950675 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.950824 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.950966 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.951114 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.951262 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.951422 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.951569 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.951729 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.951871 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.952013 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.952155 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.952320 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.952479 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.952630 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.952774 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.952915 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.953056 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.953197 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.953372 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.953571 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.953719 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.953864 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.954009 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.954151 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.954305 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:34:50.954462 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.954606 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.954749 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.954893 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.955035 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.955188 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.955337 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.955479 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.955633 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.955776 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.955919 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.956071 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.956213 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.956365 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.956516 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.956666 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.956839 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.957010 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.957163 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.957330 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.957523 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.957671 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.957824 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.958047 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.958208 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.958383 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.958526 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.958668 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.958823 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.958966 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.959109 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.959265 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.959503 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.959654 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.959806 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.959948 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.960090 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.960230 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.960372 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.960512 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.960667 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.960816 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.960958 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.961099 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.961248 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.961390 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.961566 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.961720 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.961864 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.962006 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.962149 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.962149 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.962431 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.962587 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.962740 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.962889 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.963033 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.963193 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.963337 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.963507 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.963679 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.963825 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.963979 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.964134 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.964281 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.964426 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.964572 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.964717 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.964875 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.965038 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.965187 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.965356 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.965636 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.965786 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.965930 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.966087 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.966230 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.966412 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.966554 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.966697 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.966848 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.967017 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.967174 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.967318 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.967724 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.967869 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.968020 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.968654 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.968831 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.968983 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.969134 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.969279 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.969455 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.969748 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.969904 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.970056 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.970199 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.970349 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.970500 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.970643 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.970783 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.970924 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.970924 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.971201 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.971344 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.971485 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.971627 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.971767 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.971923 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.972082 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.972226 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.972367 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.972508 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.972657 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.972800 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.972950 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.973093 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.973234 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.973382 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.973557 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.973736 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.973904 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.974048 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.974190 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.974332 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.974475 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.974627 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.974778 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.974920 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.975070 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.975219 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.975363 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.975523 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.975672 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.975817 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.975959 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.976102 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.976255 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.976407 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.976558 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.976708 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.976851 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.976994 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.977165 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.977323 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.977544 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.977697 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.977850 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.977994 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.978145 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.978297 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.978438 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.978579 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.978729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.978907 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.979065 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.979207 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.979207 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.979482 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.979651 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.979863 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.980017 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.980159 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.980300 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.980442 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.980591 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.980740 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.980895 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.981036 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.981179 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.981321 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.981499 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.981666 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.981818 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.981963 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.982107 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.982258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.982401 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.982553 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.982709 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.982865 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.983016 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.983160 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.983302 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.983458 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.983603 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.983760 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.984585 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.984735 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.984881 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.985038 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.985185 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.985334 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.985543 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.985702 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.985855 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.985998 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.986146 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.986305 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.986565 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.986710 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.986866 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.987009 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.987170 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.987342 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.987492 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.987642 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.987868 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.988011 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.988160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.988316 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.988460 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.988613 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.988765 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.988915 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.989080 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.989224 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.989365 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.989365 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.989711 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.989880 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.990105 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.990105 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.990399 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.990557 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.990716 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.990863 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.991009 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.991155 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.991302 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.991462 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.991700 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.991863 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.992010 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.992156 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.992307 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.992464 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.992613 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.992759 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.992912 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.993057 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.993204 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.993357 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.993537 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.993685 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.993829 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.994001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.994178 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.994336 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.994480 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.994635 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.994779 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.994922 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.995073 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.995217 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.995366 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.995366 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.995638 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.995784 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.995935 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.996078 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.996233 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.996384 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.996526 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.996682 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.996850 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.996995 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.997138 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.997287 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.997456 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.997677 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.997828 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.997970 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.998113 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.998259 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.998403 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.998553 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.998695 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.998838 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.998981 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.999143 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.999299 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.999471 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.999631 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.999782 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:50.999926 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.000083 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.000297 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.000451 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.000593 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.000743 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.000885 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.001029 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.001178 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.001336 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.001509 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.001657 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.001813 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.001965 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.002129 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.002273 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.002424 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.002568 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.002717 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.002860 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.003011 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.003156 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.003298 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.003448 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.003591 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.003749 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.003904 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.004063 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.004227 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.004374 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.004520 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.004674 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.004828 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.004976 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.004976 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.005256 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.005256 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.005564 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.005715 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.005866 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.005866 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.006150 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.006293 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.006444 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.006600 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.006743 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.006904 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.007149 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.007294 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.007466 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.007629 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.007772 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.007921 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.008069 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.008211 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.008363 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.008505 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.008645 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.008786 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.008926 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.009081 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.009238 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.009401 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.009669 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.009824 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.009985 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.010147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.010316 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.010535 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.010725 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.010875 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.011027 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.011182 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.011330 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.011477 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.011477 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.011754 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.011906 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.012066 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.012223 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.012370 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.012370 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.012648 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.012811 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.012957 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.013109 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.013253 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.013398 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.013555 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.013709 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.013859 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.014014 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.014157 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.014298 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.014439 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.014590 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.014742 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.014890 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.015054 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.015281 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.015434 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.015584 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.015739 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.015882 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.016037 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.016180 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.016329 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.016477 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.016629 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.016772 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.016916 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.017091 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.017235 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.017235 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.017565 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.017747 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.017899 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.018050 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.018194 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.018345 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.018487 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.018637 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.018786 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.018930 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.019072 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.019225 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.019392 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.019554 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.019706 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.019874 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.020023 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.020184 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.020346 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.020494 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.020723 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.020872 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.021028 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.021176 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.021176 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.021536 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.021685 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.021828 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.021828 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.022105 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.022105 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.022393 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.022393 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.022663 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.022805 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.022956 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.023107 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.023257 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.023400 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.023542 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.023688 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.023850 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.023993 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.024137 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.024279 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.024427 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.024576 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.024727 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.024870 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.025018 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.025160 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.025301 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.025443 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.025632 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.025632 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.025911 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.026053 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.026196 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.026381 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.026533 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.026683 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.026826 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.026976 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.027132 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.027305 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.027450 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.027598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.027758 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.027919 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.028070 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.028222 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.028368 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.028518 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.028661 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.028802 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.028944 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.029097 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.029241 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.029392 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.029585 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.029744 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.029912 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.030064 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.030206 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.030358 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.031185 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.031362 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.031516 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.031659 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.031808 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.031949 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.032103 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.032246 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.032411 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.032555 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.032697 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.032846 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.032988 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.033130 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.033130 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.033408 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.033587 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.033734 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.033877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.034039 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.034192 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.034336 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.034487 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.034632 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.034782 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.034941 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.035085 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.035236 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.035391 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.035533 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.035677 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.035829 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.035986 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.036137 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.036293 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.036443 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.036586 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.036738 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.036881 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.037023 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.037176 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.037358 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.037546 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.037694 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.037853 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.038024 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.038169 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.038312 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.038464 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.038608 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.038760 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.038910 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.039055 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.039198 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.039350 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.039492 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.039660 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.039828 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.039997 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.040150 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.040375 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.040522 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.040681 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.040894 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.041049 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.041209 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.041356 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.041570 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.041717 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.041859 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.042019 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.042171 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.042321 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.042462 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.042613 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.042773 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.042959 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.043113 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.043256 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.043397 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.043547 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.043689 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.043841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.043997 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.044140 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.044290 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.044432 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.044573 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.044723 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.044873 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.045017 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.045158 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.045306 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.045448 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.045639 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.045785 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.045934 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.046079 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.046226 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.046914 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.047069 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.047220 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.047377 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.047541 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.047684 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.047833 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.048005 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.048171 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.048318 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.048472 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.048620 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.048776 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.048923 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.049068 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.049214 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.049360 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.049566 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.049566 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.049882 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.050034 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.050193 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.050343 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.050498 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.050655 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.050798 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.051035 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.051177 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.051319 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.051459 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.051609 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.051758 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.051898 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.052045 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.052192 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.052332 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.052486 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.052635 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.052776 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.052918 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.053085 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.053237 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.053385 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.053561 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.053714 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.053864 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.054006 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.054157 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.054312 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.054457 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.054600 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.054743 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.054883 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.055033 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.055175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.055330 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.055473 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.055616 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.055771 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.055913 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.056055 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.056205 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.056347 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.056489 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.056642 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.056785 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.056927 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.057067 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.057209 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.057350 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.057574 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.057731 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.057731 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.058000 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.058165 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.058329 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.058484 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.058626 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.058767 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.058908 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.058908 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.059184 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.059333 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.059486 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.059634 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.059783 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.059929 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.060083 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.060240 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.060380 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.060522 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.060670 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.060813 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.060969 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.061190 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.061334 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.061516 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.061664 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.061816 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.061997 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.062142 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.062293 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.062436 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.062579 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.062721 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.062874 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.063016 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.063196 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.063349 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.063506 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.063666 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.063821 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.063975 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.064276 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.064423 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.064579 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.064726 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.064873 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.065021 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.065168 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.065321 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.065529 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.065800 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.065945 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.066095 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.066242 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.066426 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.066586 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.066729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.066879 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.067021 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.067164 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.067315 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.067464 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.067622 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.067622 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.067918 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.067918 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.068234 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.068403 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.068555 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.068555 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.068827 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.068827 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.069097 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.069241 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.069392 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.069573 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.069727 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.069877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.070022 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.070165 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.070330 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.070482 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.070625 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.070776 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.070926 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.071077 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.071236 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.071444 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.071598 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.071741 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.071888 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.072039 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.072183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.072328 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.072478 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.072622 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.072765 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.072916 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.073058 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.073215 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.073400 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.073599 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.073757 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.073909 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.074060 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.074202 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.074343 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.074484 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.074484 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.074768 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.074910 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.075051 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.075192 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.075340 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.075496 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.075642 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.075791 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.075932 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.076073 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.076218 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.076367 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.076516 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.076664 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.076804 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.076945 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.077085 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.077236 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.077386 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.077575 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.077735 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.077910 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.078065 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.078209 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.078378 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.078543 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.078696 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.078847 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.079034 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.079034 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.079306 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.079449 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.079604 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.079604 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.079893 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.079893 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.080169 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.080169 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.080460 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.080606 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.080761 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.080916 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.081061 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.081206 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.081358 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.081648 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.081804 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.081947 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.082090 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.082231 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.082381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.082534 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.082684 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.082829 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.082972 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.083114 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.083264 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.083446 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.083446 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.083730 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.083873 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.084014 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.084156 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.084306 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.084448 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.084590 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.084731 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.084882 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.085034 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.085176 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.085324 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.085484 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.085638 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.085783 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.086010 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.086168 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.086327 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.086574 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.086722 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.086866 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.087020 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.087163 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.087312 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.087456 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.087599 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.087743 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.087917 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.088086 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.088238 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.088383 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.088540 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.088715 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.088864 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.089011 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.089159 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.089311 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.089458 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.089653 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.089805 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.089947 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.090090 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.090232 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.090382 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.090548 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.090692 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.090833 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.090974 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.091116 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.091265 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.091421 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.091421 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.091877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.092024 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.092167 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.092323 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.092732 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.092876 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.093018 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.093717 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.093894 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.094123 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.094280 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.094280 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.094567 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.094721 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.094867 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.095023 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.095169 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.095316 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.095464 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.095610 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.095757 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.095921 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.096073 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.096223 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.096369 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.096523 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.096678 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.096824 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.096977 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.097123 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.097270 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.097414 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.097623 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.097773 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.097924 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.098081 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.098262 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.098404 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.098565 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.098734 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.098879 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.099021 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.099021 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.099304 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.099446 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.099589 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.099731 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.099877 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.100018 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.100168 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.100309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.100451 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.100608 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.100750 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.100897 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.101047 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.101189 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.101329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.101496 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.101655 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.101811 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.102036 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.102181 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.102333 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.102477 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.102621 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.102775 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.102919 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.103072 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.103216 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.103358 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.103507 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.103660 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.103812 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.103986 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.104135 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.104135 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.104424 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.104572 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.104719 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.104719 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.104998 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.105147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.105307 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.105515 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.105664 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.105808 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.105961 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.106117 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.106260 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.106403 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.106544 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.106700 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.106844 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.107000 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.107153 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.107316 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.107468 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.107611 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.107752 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.107903 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.108047 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.108215 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.108380 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.108523 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.108673 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.108901 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.109582 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.109735 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.109881 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.110030 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.110188 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.110188 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.110462 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.110630 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.110815 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.110968 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.111126 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.111272 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.111418 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.111418 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.111707 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.111855 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.112026 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.112248 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.112396 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.112543 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.112690 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.112856 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.113003 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.113150 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.113296 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.113444 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.113627 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.113782 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.113926 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.114102 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.114250 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.114392 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.114533 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.114684 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.114826 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.114968 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.115110 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.115252 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.115402 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.115564 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.115564 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.115853 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.116002 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.116148 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.116300 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.116451 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.116593 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.116735 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.116875 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.117016 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.117167 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.117167 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.117443 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.117637 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.117791 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.117936 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.118089 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.118233 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.118393 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.118554 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.118699 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.118845 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.119027 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.119183 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.119327 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.119478 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.119624 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.119776 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.119922 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.120073 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.120218 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.120361 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.120504 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.120675 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.120832 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.120979 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.121125 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.121277 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.121425 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.121639 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.121784 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.121926 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.122068 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.122233 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.122450 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.122673 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.122819 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.122962 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.123112 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.123270 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.123450 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.123598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.123742 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.123884 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.124026 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.124026 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.124346 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.124512 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.124654 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.124797 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.124948 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.125099 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.125250 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.125399 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.125570 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.125717 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.125873 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.126018 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.126174 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.126327 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.126470 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.126621 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.126765 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.126917 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.127069 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.127213 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.127370 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.127515 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.127658 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.127810 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.127956 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.127956 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.128229 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.128379 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.128543 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.128713 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.128856 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.129017 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.129195 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.129343 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.129549 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.129708 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.129852 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.129995 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.130154 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.130333 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.130488 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.130631 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.130796 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.130941 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.131085 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.131233 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.131386 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.131529 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.131529 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.131797 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.131948 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.132091 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.132242 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.132384 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.132606 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.132748 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.132891 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.133047 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.133198 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.133341 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.133514 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.133662 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.133806 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.133962 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.134107 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.134268 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.134431 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.134577 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.134720 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.134874 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.135024 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.135178 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.135323 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.135470 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.135640 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.135784 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.135927 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.136070 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.136217 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.136361 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.136513 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.136661 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.136815 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.136963 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.137110 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.137256 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.137416 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.137610 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.137768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.137913 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.138055 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.138196 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.138349 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.138493 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.138652 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.138820 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.138965 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.139125 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.139296 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.139450 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.139593 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.139735 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.139876 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.140052 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.140198 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.140340 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.140490 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.140637 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.140780 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.140952 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.141095 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.141237 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.141393 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.141563 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.141723 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.141868 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.142011 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.142162 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.142307 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.142456 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.142627 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.142839 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.142984 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.142984 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.143257 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.143411 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.143569 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.143714 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.143857 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.144002 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.144144 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.144301 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.144479 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.144641 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.144789 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.144936 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.145083 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.145240 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.145400 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.145571 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.145571 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.145846 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.145990 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.146155 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.146300 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.146449 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.146601 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.146746 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.146888 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.147042 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.147186 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.147338 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.147482 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.147626 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.147779 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.147924 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.148067 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.148216 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.148361 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.148504 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.148657 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.148825 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.148989 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.149133 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.149309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.149530 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.149691 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.149835 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.149979 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.150121 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.150268 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.150411 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.150629 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.150773 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.150933 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.151079 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.151221 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.151378 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.151521 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.151663 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.151806 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.151948 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.152097 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.152257 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.152406 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.152549 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.152690 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.152849 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.153060 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.153214 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.153358 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.153520 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.153663 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.153822 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.153974 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.154131 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.154274 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.154416 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.154590 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.154747 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.154747 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.155029 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.155029 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.155029 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.155029 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.155029 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.155029 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.155029 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.155029 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.156646 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.156646 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.156646 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.156646 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.156646 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.156646 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.156646 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.157646 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.157646 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.157646 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.158061 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.158327 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.158692 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.159031 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.159344 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.159518 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.159819 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.159974 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.160117 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 10:34:51.160261 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.160566 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.160922 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.161267 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.161641 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.161974 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.162317 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.162658 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.162990 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.163315 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.163663 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.163988 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.164312 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.164644 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.164964 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.165287 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.165633 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.165976 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.166315 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.166634 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.166972 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.167301 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.167630 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.167954 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.168275 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.168611 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.168932 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.169255 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.169600 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.169917 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.170235 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.170560 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.170879 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.171199 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.172084 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.172408 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.172744 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.173080 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.173400 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.173761 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.174096 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.174455 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.174781 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.175133 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.175469 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.175794 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.176117 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.176432 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:34:51.176681 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 10:34:51.314653 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO dbcounter [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] Registered counter for database nova_api Aug 03 10:34:51.330970 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO dbcounter [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] Registered counter for database nova_api Aug 03 10:34:51.335962 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG oslo_db.sqlalchemy.engines [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:34:51.342867 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG dbcounter [-] [109880] Writer thread running {{(pid=109880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:34:51.351604 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_db.sqlalchemy.engines [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109881) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:34:51.358495 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writer thread running {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:34:51.407544 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.context [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4d171320-82a2-402f-aa25-567d87407a2a(cell1) {{(pid=109880) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 10:34:51.411731 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG oslo_concurrency.lockutils [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:34:51.413387 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG oslo_concurrency.lockutils [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:34:51.414259 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG oslo_concurrency.lockutils [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:34:51.416374 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG oslo_concurrency.lockutils [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:34:51.418550 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO dbcounter [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] Registered counter for database nova_cell0 Aug 03 10:34:51.418786 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.context [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4d171320-82a2-402f-aa25-567d87407a2a(cell1) {{(pid=109881) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 10:34:51.423210 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:34:51.424526 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO dbcounter [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] Registered counter for database nova_cell1 Aug 03 10:34:51.424856 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:34:51.425718 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:34:51.427866 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:34:51.429965 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO dbcounter [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] Registered counter for database nova_cell0 Aug 03 10:34:51.431994 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG oslo_db.sqlalchemy.engines [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:34:51.433398 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG oslo_db.sqlalchemy.engines [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:34:51.436136 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO dbcounter [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] Registered counter for database nova_cell1 Aug 03 10:34:51.440179 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG dbcounter [-] [109880] Writer thread running {{(pid=109880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:34:51.441680 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG dbcounter [-] [109880] Writer thread running {{(pid=109880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:34:51.443902 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_db.sqlalchemy.engines [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109881) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:34:51.447376 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_db.sqlalchemy.engines [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109881) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:34:51.454681 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writer thread running {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:34:51.598741 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO dbcounter [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] Registered counter for database nova_cell0 Aug 03 10:34:51.604391 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writer thread running {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:34:51.607933 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG oslo_db.sqlalchemy.engines [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:34:51.612983 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG dbcounter [-] [109880] Writer thread running {{(pid=109880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:34:51.615245 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO dbcounter [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] Registered counter for database nova_cell0 Aug 03 10:34:51.622134 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_db.sqlalchemy.engines [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109881) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:34:51.626748 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writer thread running {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:34:51.955556 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: WARNING keystonemiddleware.auth_token [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 10:34:51.960437 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: WARNING keystonemiddleware.auth_token [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 10:34:51.962810 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: WARNING keystonemiddleware.auth_token [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 10:34:51.968086 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: WARNING keystonemiddleware.auth_token [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 10:34:52.303907 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: WARNING keystonemiddleware.auth_token [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 10:34:52.310100 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: WARNING keystonemiddleware.auth_token [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 10:34:52.311742 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: WARNING keystonemiddleware.auth_token [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 10:34:52.316995 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce334389c0 pid: 109881 (default app) Aug 03 10:34:52.318672 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: WARNING keystonemiddleware.auth_token [None req-475f1ac6-23c7-4ae2-9001-12eb62e60c01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 10:34:52.319235 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:34:52.320454 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001892 Aug 03 10:34:52.320883 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Wed Aug 3 10:34:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:34:52.324237 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce334389c0 pid: 109880 (default app) Aug 03 10:36:14.865988 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:36:14.867035 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Aug 03 10:36:14.867503 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 930 bytes} [Wed Aug 3 10:36:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:36:14.882871 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG dbcounter [-] [109880] Writing DB stats nova_api:SELECT=3 {{(pid=109880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:36:14.884802 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG dbcounter [-] [109880] Writing DB stats nova_cell0:SELECT=3 {{(pid=109880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:36:14.885721 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG dbcounter [-] [109880] Writing DB stats nova_cell1:SELECT=3 {{(pid=109880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:36:14.886610 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG dbcounter [-] [109880] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:36:15.794166 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-9ef77c76-3ab3-44ae-bd35-a8f909797d42 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:36:15.827708 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-9ef77c76-3ab3-44ae-bd35-a8f909797d42 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.950026 Aug 03 10:36:15.828682 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Aug 3 10:36:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:36:18.233210 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:36:18.235252 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-bf4d4087-478d-4d7c-b5f9-5f1cb3dfe8a3 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002953 Aug 03 10:36:18.236531 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 930 bytes} [Wed Aug 3 10:36:18 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:36:18.796589 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-38b99763-c8bc-4d74-b7df-0d733104feb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 256, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:18.816635 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 10:36:18.816635 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: warnings.warn(msg) Aug 03 10:36:18.845335 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-38b99763-c8bc-4d74-b7df-0d733104feb1 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.601092 Aug 03 10:36:18.845948 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Aug 3 10:36:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:36:19.072779 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-46eaef1b-e133-4514-9ae4-c7c02a480c9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:19.077249 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 10:36:19.077249 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: warnings.warn(msg) Aug 03 10:36:19.079861 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_api:SELECT=3 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:36:19.080807 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_cell0:SELECT=3 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:36:19.081768 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_cell1:SELECT=3 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:36:19.082747 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:36:19.156453 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-46eaef1b-e133-4514-9ae4-c7c02a480c9b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.302205 Aug 03 10:36:19.157404 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Aug 3 10:36:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:36:21.399592 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-38b99763-c8bc-4d74-b7df-0d733104feb1 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:36:21.400610 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-38b99763-c8bc-4d74-b7df-0d733104feb1 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 03 10:36:21.401280 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 930 bytes} [Wed Aug 3 10:36:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:36:22.134841 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-2f417171-c3a0-4cbb-808c-7bc486fd996c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "rxtx_factor": 1.0, "swap": 0, "id": "d1", "vcpus": 1, "ram": 512, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:22.154504 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 10:36:22.154504 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: warnings.warn(msg) Aug 03 10:36:22.177123 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-2f417171-c3a0-4cbb-808c-7bc486fd996c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.769511 Aug 03 10:36:22.177944 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Aug 3 10:36:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:36:22.190049 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-6d232b8a-9b0a-41ca-a6bb-074292eddb26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:22.192898 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 10:36:22.192898 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: warnings.warn(msg) Aug 03 10:36:22.235956 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-6d232b8a-9b0a-41ca-a6bb-074292eddb26 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050173 Aug 03 10:36:22.236795 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Aug 3 10:36:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:36:24.863246 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-2f417171-c3a0-4cbb-808c-7bc486fd996c admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:36:24.864265 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-2f417171-c3a0-4cbb-808c-7bc486fd996c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 03 10:36:24.864680 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 930 bytes} [Wed Aug 3 10:36:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:36:25.275259 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-ac7955f7-1acb-417a-8b9c-36bfa92c18b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:25.294669 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-ac7955f7-1acb-417a-8b9c-36bfa92c18b7 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.423770 Aug 03 10:36:25.295146 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Aug 3 10:36:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:36:25.307251 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-a5f73d2a-0a30-4ed3-b42f-f946bce2bdb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:25.333572 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-a5f73d2a-0a30-4ed3-b42f-f946bce2bdb4 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029929 Aug 03 10:36:25.349499 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Aug 3 10:36:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:36:27.592571 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-ac7955f7-1acb-417a-8b9c-36bfa92c18b7 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:36:27.593487 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-ac7955f7-1acb-417a-8b9c-36bfa92c18b7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 03 10:36:27.594350 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 930 bytes} [Wed Aug 3 10:36:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:36:28.119719 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-252cb64e-3dcc-416a-8696-a3645682975e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "ram": 2048, "id": "d3"}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:28.140196 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-252cb64e-3dcc-416a-8696-a3645682975e admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.540015 Aug 03 10:36:28.141016 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Aug 3 10:36:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:36:28.152834 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-9071f501-3e81-452d-bb97-834e546b2d7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:28.178819 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-9071f501-3e81-452d-bb97-834e546b2d7f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029511 Aug 03 10:36:28.193529 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Aug 3 10:36:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:36:30.463021 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-252cb64e-3dcc-416a-8696-a3645682975e admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:36:30.464034 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-252cb64e-3dcc-416a-8696-a3645682975e admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Aug 03 10:36:30.464442 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 930 bytes} [Wed Aug 3 10:36:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:36:30.954419 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-7dce8bad-9264-45c1-9bda-54d0c0320028 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:30.976184 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-7dce8bad-9264-45c1-9bda-54d0c0320028 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.505241 Aug 03 10:36:30.977014 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Aug 3 10:36:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 10:36:30.990501 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-33eaba99-52b0-4379-8b8a-e28bece16aab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:31.017067 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-33eaba99-52b0-4379-8b8a-e28bece16aab admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030524 Aug 03 10:36:31.017839 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Aug 3 10:36:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:36:33.406959 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-7dce8bad-9264-45c1-9bda-54d0c0320028 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:36:33.407817 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-7dce8bad-9264-45c1-9bda-54d0c0320028 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Aug 03 10:36:33.408220 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 930 bytes} [Wed Aug 3 10:36:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:36:33.930076 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-df03ab01-fa11-4560-acd1-bc314f990f94 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:36:33.955514 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-df03ab01-fa11-4560-acd1-bc314f990f94 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.538181 Aug 03 10:36:33.956107 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Aug 3 10:36:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:36:36.348919 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-7dce8bad-9264-45c1-9bda-54d0c0320028 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:36:36.350448 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-7dce8bad-9264-45c1-9bda-54d0c0320028 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002176 Aug 03 10:36:36.351024 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 930 bytes} [Wed Aug 3 10:36:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:36:36.823649 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-3a533874-633b-42b2-b6ac-7cacadb5d064 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1, "ram": 512, "disk": 1}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:36.848895 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-3a533874-633b-42b2-b6ac-7cacadb5d064 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.488836 Aug 03 10:36:36.849677 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Aug 3 10:36:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:36:36.862134 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-3c3c305c-31d0-4818-ba50-920691eeebd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:36.887486 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-3c3c305c-31d0-4818-ba50-920691eeebd1 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029642 Aug 03 10:36:36.888105 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Aug 3 10:36:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:36:39.110942 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-3a533874-633b-42b2-b6ac-7cacadb5d064 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:36:39.111961 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-3a533874-633b-42b2-b6ac-7cacadb5d064 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 03 10:36:39.112544 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 930 bytes} [Wed Aug 3 10:36:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:36:39.583604 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-d70107f7-e6ff-46c2-b068-9722cee1906a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "id": "2", "ram": 2048, "name": "m1.small"}} {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:39.605054 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-d70107f7-e6ff-46c2-b068-9722cee1906a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.486420 Aug 03 10:36:39.605627 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Aug 3 10:36:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 10:36:39.617580 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-a7ad0f12-6c64-4f1c-a6c8-a86c6e06b8c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:39.643469 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-a7ad0f12-6c64-4f1c-a6c8-a86c6e06b8c9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029582 Aug 03 10:36:39.647300 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Aug 3 10:36:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:36:41.861712 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-d70107f7-e6ff-46c2-b068-9722cee1906a admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:36:41.862732 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-d70107f7-e6ff-46c2-b068-9722cee1906a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 03 10:36:41.867410 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 930 bytes} [Wed Aug 3 10:36:41 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:36:42.291174 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-d88a6ad5-697d-482f-bff3-e5cfa501e4bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "swap": 0, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:42.348171 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-d88a6ad5-697d-482f-bff3-e5cfa501e4bc admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.474977 Aug 03 10:36:42.349036 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Aug 3 10:36:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:36:42.361667 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-1d9a04ad-9e4d-490e-b05b-77d0ec0a350a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:42.389775 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-1d9a04ad-9e4d-490e-b05b-77d0ec0a350a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031283 Aug 03 10:36:42.405708 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Aug 3 10:36:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:36:44.651730 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-d88a6ad5-697d-482f-bff3-e5cfa501e4bc admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:36:44.653386 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-d88a6ad5-697d-482f-bff3-e5cfa501e4bc admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002166 Aug 03 10:36:44.653828 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 930 bytes} [Wed Aug 3 10:36:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:36:45.188906 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-34c1c50b-bf8d-409a-b14d-aea3e6badb3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:45.207141 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG dbcounter [-] [109880] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:36:45.223066 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-34c1c50b-bf8d-409a-b14d-aea3e6badb3e admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.562041 Aug 03 10:36:45.224603 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Aug 3 10:36:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 10:36:45.236651 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-a1178c6f-dfda-4cd4-87d8-73c9d6e0dddd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:45.267235 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-a1178c6f-dfda-4cd4-87d8-73c9d6e0dddd admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034270 Aug 03 10:36:45.268125 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Aug 3 10:36:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:36:47.605315 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-34c1c50b-bf8d-409a-b14d-aea3e6badb3e admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:36:47.606965 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-34c1c50b-bf8d-409a-b14d-aea3e6badb3e admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002183 Aug 03 10:36:47.607620 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 930 bytes} [Wed Aug 3 10:36:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:36:48.083567 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-ba1a1ca3-7722-4765-ae43-dd9f61b21ecf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "id": "5", "ram": 16384, "rxtx_factor": 1.0}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:48.103793 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-ba1a1ca3-7722-4765-ae43-dd9f61b21ecf admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.488699 Aug 03 10:36:48.111381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Aug 3 10:36:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:36:48.116336 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-dcc2f6ea-5179-48e1-88f6-892321b40e13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:36:48.145865 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-dcc2f6ea-5179-48e1-88f6-892321b40e13 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032521 Aug 03 10:36:48.157786 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Aug 3 10:36:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:37:07.585584 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-ba1a1ca3-7722-4765-ae43-dd9f61b21ecf admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:07.586600 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-ba1a1ca3-7722-4765-ae43-dd9f61b21ecf admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 03 10:37:07.586987 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 930 bytes} [Wed Aug 3 10:37:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:37:07.598067 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG dbcounter [-] [109880] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=109880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:37:07.986099 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-0de3dfaf-3de6-4152-b43a-9e378d2a04c1 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:08.004030 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-0de3dfaf-3de6-4152-b43a-9e378d2a04c1 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410540 Aug 03 10:37:08.004576 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Aug 3 10:37:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:37:09.084075 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-ba1a1ca3-7722-4765-ae43-dd9f61b21ecf admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:09.085071 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-ba1a1ca3-7722-4765-ae43-dd9f61b21ecf admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 03 10:37:09.085479 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 3 10:37:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:37:09.627317 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-81eb10bf-c12d-4f71-813c-5ded24d71cb5 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:09.632898 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.wsgi [None req-81eb10bf-c12d-4f71-813c-5ded24d71cb5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-81eb10bf-c12d-4f71-813c-5ded24d71cb5 admin admin] Request method failure captured: Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Accept: application/json Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Accept-Encoding: gzip, deflate Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Connection: keep-alive Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Content-Length: 0 Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Host: 10.222.0.47 Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Openstack-Api-Version: compute 2.90 Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Openstack-System-Scope: None Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: User-Agent: python-novaclient Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Auth-Token: gAAAAABi6k_UPDIcChBBgQgbzrwvfxQaeU7FgLvXIczACAAs_i8V-CwqA5T1K92wXqojeiJ3jdzGXrhaepx5aGXklIc6BbvJMfYGY2yyd1JEvtl2qqzkYdcEWmbPjfw8fv8m7a962gYVATY19GPXipTS69ys1_r-i42dxmGdAGZ0BDne2Z19g5k Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Domain-Id: None Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Domain-Name: None Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Identity-Status: Confirmed Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Is-Admin-Project: True Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Project-Domain-Id: default Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Project-Domain-Name: Default Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Project-Id: a90579cdd4284a47979efcd0ca29e39a Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Project-Name: admin Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Role: admin,member,reader Aug 03 10:37:09.636175 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Roles: admin,member,reader Aug 03 10:37:09.637877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a90579cdd4284a47979efcd0ca29e39a", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:37:09.637877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Tenant: admin Aug 03 10:37:09.637877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Tenant-Id: a90579cdd4284a47979efcd0ca29e39a Aug 03 10:37:09.637877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Tenant-Name: admin Aug 03 10:37:09.637877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-User: admin Aug 03 10:37:09.637877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-User-Domain-Id: default Aug 03 10:37:09.637877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-User-Domain-Name: Default Aug 03 10:37:09.637877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-User-Id: fb1a77890b95445982cf98d4ad77cb92 Aug 03 10:37:09.637877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-User-Name: admin Aug 03 10:37:09.637877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: method: > Aug 03 10:37:09.637877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: exception: Flavor 42 could not be found. Aug 03 10:37:09.637877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: action_args: {'id': '42'} Aug 03 10:37:09.637877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:37:09.637877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:37:09.638809 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Aug 03 10:37:09.640598 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-81eb10bf-c12d-4f71-813c-5ded24d71cb5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:37:09.641709 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-81eb10bf-c12d-4f71-813c-5ded24d71cb5 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.413253 Aug 03 10:37:09.641709 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Aug 3 10:37:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 414 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 03 10:37:09.647794 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-a1a1e3cb-9504-4a51-b16f-e1da5d30d37e admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:09.652082 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:37:09.672681 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-a1a1e3cb-9504-4a51-b16f-e1da5d30d37e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028419 Aug 03 10:37:09.673241 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 3 10:37:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:37:09.683162 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-a172bcd1-5293-41f2-9963-b35bf3a9755b admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:09.708322 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-a172bcd1-5293-41f2-9963-b35bf3a9755b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028674 Aug 03 10:37:09.708891 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 3 10:37:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:37:09.718900 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-e8ab6df3-9fa5-49f5-8753-ea545aea5354 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:09.726403 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.wsgi [None req-e8ab6df3-9fa5-49f5-8753-ea545aea5354 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-e8ab6df3-9fa5-49f5-8753-ea545aea5354 admin admin] Request method failure captured: Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Accept: application/json Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Accept-Encoding: gzip, deflate Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Connection: keep-alive Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Content-Length: 0 Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Host: 10.222.0.47 Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Openstack-Api-Version: compute 2.90 Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Openstack-System-Scope: None Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: User-Agent: python-novaclient Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Auth-Token: gAAAAABi6k_UPDIcChBBgQgbzrwvfxQaeU7FgLvXIczACAAs_i8V-CwqA5T1K92wXqojeiJ3jdzGXrhaepx5aGXklIc6BbvJMfYGY2yyd1JEvtl2qqzkYdcEWmbPjfw8fv8m7a962gYVATY19GPXipTS69ys1_r-i42dxmGdAGZ0BDne2Z19g5k Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Domain-Id: None Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Domain-Name: None Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Identity-Status: Confirmed Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Is-Admin-Project: True Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Project-Domain-Id: default Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Project-Domain-Name: Default Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Project-Id: a90579cdd4284a47979efcd0ca29e39a Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Project-Name: admin Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Role: admin,member,reader Aug 03 10:37:09.729381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Roles: admin,member,reader Aug 03 10:37:09.731473 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a90579cdd4284a47979efcd0ca29e39a", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:37:09.731473 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Tenant: admin Aug 03 10:37:09.731473 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Tenant-Id: a90579cdd4284a47979efcd0ca29e39a Aug 03 10:37:09.731473 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Tenant-Name: admin Aug 03 10:37:09.731473 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-User: admin Aug 03 10:37:09.731473 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-User-Domain-Id: default Aug 03 10:37:09.731473 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-User-Domain-Name: Default Aug 03 10:37:09.731473 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-User-Id: fb1a77890b95445982cf98d4ad77cb92 Aug 03 10:37:09.731473 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-User-Name: admin Aug 03 10:37:09.731473 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: method: > Aug 03 10:37:09.731473 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: exception: Flavor 42 could not be found. Aug 03 10:37:09.731473 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: action_args: {'id': '42'} Aug 03 10:37:09.731473 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:37:09.731473 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:37:09.733001 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 03 10:37:09.735266 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-e8ab6df3-9fa5-49f5-8753-ea545aea5354 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:37:09.737368 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-e8ab6df3-9fa5-49f5-8753-ea545aea5354 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016012 Aug 03 10:37:09.737368 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Aug 3 10:37:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 10:37:10.722480 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-a172bcd1-5293-41f2-9963-b35bf3a9755b admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:10.723485 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-a172bcd1-5293-41f2-9963-b35bf3a9755b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 03 10:37:10.723896 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 3 10:37:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:37:11.262198 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-3b081c01-1d43-43f1-ba6c-4507f1cac13a admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:11.270213 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.wsgi [None req-3b081c01-1d43-43f1-ba6c-4507f1cac13a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-3b081c01-1d43-43f1-ba6c-4507f1cac13a admin admin] Request method failure captured: Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Accept: application/json Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Accept-Encoding: gzip, deflate Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Connection: keep-alive Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Content-Length: 0 Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Host: 10.222.0.47 Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Openstack-Api-Version: compute 2.90 Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Openstack-System-Scope: None Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: User-Agent: python-novaclient Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Auth-Token: gAAAAABi6k_Woujbovo4guOqRHdG_KQZS54L6kqzV3Ax6mWOZc3bDeNeXWxEjEzBRMvdvDOrBDfWihDnGJGirFV5D10dCzE3YBaYWwW8ZlXCKMmzjpwmsUS3V8cP6B3guZhcmdgFQXk5yTe-6t5lHDWJrfYffeaod5m9c14dGoPi8pM7upVHg44 Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Domain-Id: None Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Domain-Name: None Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Identity-Status: Confirmed Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Is-Admin-Project: True Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Project-Domain-Id: default Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Project-Domain-Name: Default Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Project-Id: a90579cdd4284a47979efcd0ca29e39a Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Project-Name: admin Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Role: admin,member,reader Aug 03 10:37:11.271729 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Roles: admin,member,reader Aug 03 10:37:11.273258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a90579cdd4284a47979efcd0ca29e39a", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:37:11.273258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Tenant: admin Aug 03 10:37:11.273258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Tenant-Id: a90579cdd4284a47979efcd0ca29e39a Aug 03 10:37:11.273258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Tenant-Name: admin Aug 03 10:37:11.273258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-User: admin Aug 03 10:37:11.273258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-User-Domain-Id: default Aug 03 10:37:11.273258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-User-Domain-Name: Default Aug 03 10:37:11.273258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-User-Id: fb1a77890b95445982cf98d4ad77cb92 Aug 03 10:37:11.273258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-User-Name: admin Aug 03 10:37:11.273258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: method: > Aug 03 10:37:11.273258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: exception: Flavor 84 could not be found. Aug 03 10:37:11.273258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: action_args: {'id': '84'} Aug 03 10:37:11.273258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:37:11.273258 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:37:11.274183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 03 10:37:11.275243 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-3b081c01-1d43-43f1-ba6c-4507f1cac13a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:37:11.276423 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-3b081c01-1d43-43f1-ba6c-4507f1cac13a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.406212 Aug 03 10:37:11.276423 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Aug 3 10:37:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 10:37:11.282730 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-f8b833e9-46d3-4bb4-928c-dd665418a473 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:11.297397 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-f8b833e9-46d3-4bb4-928c-dd665418a473 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018157 Aug 03 10:37:11.297953 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 3 10:37:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:37:11.307245 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-28754e2f-32d1-45ca-ba0d-ecab1de6cb5f admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:11.322583 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-28754e2f-32d1-45ca-ba0d-ecab1de6cb5f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018749 Aug 03 10:37:11.323135 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 3 10:37:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:37:11.337159 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-16e9d23d-6b02-45ae-8ea6-f4d32a3244cb admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:11.342782 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.wsgi [None req-16e9d23d-6b02-45ae-8ea6-f4d32a3244cb admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-16e9d23d-6b02-45ae-8ea6-f4d32a3244cb admin admin] Request method failure captured: Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Accept: application/json Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Accept-Encoding: gzip, deflate Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Connection: keep-alive Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Content-Length: 0 Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Host: 10.222.0.47 Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Openstack-Api-Version: compute 2.90 Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Openstack-System-Scope: None Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: User-Agent: python-novaclient Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Auth-Token: gAAAAABi6k_Woujbovo4guOqRHdG_KQZS54L6kqzV3Ax6mWOZc3bDeNeXWxEjEzBRMvdvDOrBDfWihDnGJGirFV5D10dCzE3YBaYWwW8ZlXCKMmzjpwmsUS3V8cP6B3guZhcmdgFQXk5yTe-6t5lHDWJrfYffeaod5m9c14dGoPi8pM7upVHg44 Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Domain-Id: None Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Domain-Name: None Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Identity-Status: Confirmed Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Is-Admin-Project: True Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Project-Domain-Id: default Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Project-Domain-Name: Default Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Project-Id: a90579cdd4284a47979efcd0ca29e39a Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Project-Name: admin Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Role: admin,member,reader Aug 03 10:37:11.344309 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Roles: admin,member,reader Aug 03 10:37:11.346844 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a90579cdd4284a47979efcd0ca29e39a", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:37:11.346844 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Tenant: admin Aug 03 10:37:11.346844 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Tenant-Id: a90579cdd4284a47979efcd0ca29e39a Aug 03 10:37:11.346844 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Tenant-Name: admin Aug 03 10:37:11.346844 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-User: admin Aug 03 10:37:11.346844 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-User-Domain-Id: default Aug 03 10:37:11.346844 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-User-Domain-Name: Default Aug 03 10:37:11.346844 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-User-Id: fb1a77890b95445982cf98d4ad77cb92 Aug 03 10:37:11.346844 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-User-Name: admin Aug 03 10:37:11.346844 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: method: > Aug 03 10:37:11.346844 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: exception: Flavor 84 could not be found. Aug 03 10:37:11.346844 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: action_args: {'id': '84'} Aug 03 10:37:11.346844 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:37:11.346844 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:37:11.348160 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Aug 03 10:37:11.349768 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-16e9d23d-6b02-45ae-8ea6-f4d32a3244cb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:37:11.351000 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-16e9d23d-6b02-45ae-8ea6-f4d32a3244cb admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012157 Aug 03 10:37:11.351000 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Aug 3 10:37:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 03 10:37:12.325208 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-28754e2f-32d1-45ca-ba0d-ecab1de6cb5f admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:12.326263 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-28754e2f-32d1-45ca-ba0d-ecab1de6cb5f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 03 10:37:12.327251 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 3 10:37:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:37:12.871051 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-b9eea01d-facb-482f-9d69-387648ddfe0b admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:12.877852 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.wsgi [None req-b9eea01d-facb-482f-9d69-387648ddfe0b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-b9eea01d-facb-482f-9d69-387648ddfe0b admin admin] Request method failure captured: Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Accept: application/json Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Accept-Encoding: gzip, deflate Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Connection: keep-alive Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Content-Length: 0 Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Host: 10.222.0.47 Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Openstack-Api-Version: compute 2.90 Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Openstack-System-Scope: None Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: User-Agent: python-novaclient Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Auth-Token: gAAAAABi6k_YNPK80-a36kp-Id4VnKMC5XeXIwbHin9cZdCX4JnktaIEUfgODi1A3dOGctppORk8epms6gsyJZkz3jTQy0CTbgV54Nwz8wALNvhOzwXpr1l3RIVD3mfY-tzlQf0p4e38dTHDCvmHCQv6RCL1cjx4bmq_dEjVTdj6OL8p4C-aUew Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Domain-Id: None Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Domain-Name: None Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Identity-Status: Confirmed Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Is-Admin-Project: True Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Project-Domain-Id: default Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Project-Domain-Name: Default Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Project-Id: a90579cdd4284a47979efcd0ca29e39a Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Project-Name: admin Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Role: admin,member,reader Aug 03 10:37:12.879352 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Roles: admin,member,reader Aug 03 10:37:12.880902 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a90579cdd4284a47979efcd0ca29e39a", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:37:12.880902 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Tenant: admin Aug 03 10:37:12.880902 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Tenant-Id: a90579cdd4284a47979efcd0ca29e39a Aug 03 10:37:12.880902 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-Tenant-Name: admin Aug 03 10:37:12.880902 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-User: admin Aug 03 10:37:12.880902 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-User-Domain-Id: default Aug 03 10:37:12.880902 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-User-Domain-Name: Default Aug 03 10:37:12.880902 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-User-Id: fb1a77890b95445982cf98d4ad77cb92 Aug 03 10:37:12.880902 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: X-User-Name: admin Aug 03 10:37:12.880902 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: method: > Aug 03 10:37:12.880902 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: exception: Flavor 451 could not be found. Aug 03 10:37:12.880902 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: action_args: {'id': '451'} Aug 03 10:37:12.880902 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:37:12.880902 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:37:12.881841 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: ERROR nova.api.openstack.wsgi Aug 03 10:37:12.883147 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-b9eea01d-facb-482f-9d69-387648ddfe0b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:37:12.884442 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-b9eea01d-facb-482f-9d69-387648ddfe0b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.416082 Aug 03 10:37:12.884442 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 3 10:37:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 10:37:12.891076 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-b8878963-8f6c-42f3-aeeb-8835de8a66a9 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:12.905672 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-b8878963-8f6c-42f3-aeeb-8835de8a66a9 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018696 Aug 03 10:37:12.906206 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 3 10:37:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:37:12.915887 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-9a0924e2-9ed8-4243-919d-cfc856e34912 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:12.931656 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-9a0924e2-9ed8-4243-919d-cfc856e34912 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019427 Aug 03 10:37:12.932187 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 3 10:37:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:37:12.941887 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-59f6ddf0-2cd9-46e2-a228-02ef0a6b57db admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:12.947442 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.wsgi [None req-59f6ddf0-2cd9-46e2-a228-02ef0a6b57db admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-59f6ddf0-2cd9-46e2-a228-02ef0a6b57db admin admin] Request method failure captured: Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Accept: application/json Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Accept-Encoding: gzip, deflate Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Connection: keep-alive Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Content-Length: 0 Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Host: 10.222.0.47 Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Openstack-Api-Version: compute 2.90 Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Openstack-System-Scope: None Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: User-Agent: python-novaclient Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Auth-Token: gAAAAABi6k_YNPK80-a36kp-Id4VnKMC5XeXIwbHin9cZdCX4JnktaIEUfgODi1A3dOGctppORk8epms6gsyJZkz3jTQy0CTbgV54Nwz8wALNvhOzwXpr1l3RIVD3mfY-tzlQf0p4e38dTHDCvmHCQv6RCL1cjx4bmq_dEjVTdj6OL8p4C-aUew Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Domain-Id: None Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Domain-Name: None Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Identity-Status: Confirmed Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Is-Admin-Project: True Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Project-Domain-Id: default Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Project-Domain-Name: Default Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Project-Id: a90579cdd4284a47979efcd0ca29e39a Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Project-Name: admin Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Role: admin,member,reader Aug 03 10:37:12.949032 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Roles: admin,member,reader Aug 03 10:37:12.950546 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a90579cdd4284a47979efcd0ca29e39a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a90579cdd4284a47979efcd0ca29e39a", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:37:12.950546 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Tenant: admin Aug 03 10:37:12.950546 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Tenant-Id: a90579cdd4284a47979efcd0ca29e39a Aug 03 10:37:12.950546 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-Tenant-Name: admin Aug 03 10:37:12.950546 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-User: admin Aug 03 10:37:12.950546 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-User-Domain-Id: default Aug 03 10:37:12.950546 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-User-Domain-Name: Default Aug 03 10:37:12.950546 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-User-Id: fb1a77890b95445982cf98d4ad77cb92 Aug 03 10:37:12.950546 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: X-User-Name: admin Aug 03 10:37:12.950546 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: method: > Aug 03 10:37:12.950546 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: exception: Flavor 451 could not be found. Aug 03 10:37:12.950546 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: action_args: {'id': '451'} Aug 03 10:37:12.950546 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:37:12.950546 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:37:12.951329 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: ERROR nova.api.openstack.wsgi Aug 03 10:37:12.953140 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-59f6ddf0-2cd9-46e2-a228-02ef0a6b57db admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:37:12.954385 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-59f6ddf0-2cd9-46e2-a228-02ef0a6b57db admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012046 Aug 03 10:37:12.954385 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 3 10:37:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 10:37:13.940963 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-9a0924e2-9ed8-4243-919d-cfc856e34912 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:13.941981 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-9a0924e2-9ed8-4243-919d-cfc856e34912 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 03 10:37:13.942370 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 3 10:37:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:37:14.465964 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-8a2f1a4c-10fb-4aac-a452-318bfe1c80bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:37:14.486631 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-8a2f1a4c-10fb-4aac-a452-318bfe1c80bd admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.407901 Aug 03 10:37:14.487115 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Aug 3 10:37:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:37:15.470351 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-9a0924e2-9ed8-4243-919d-cfc856e34912 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:15.471611 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-9a0924e2-9ed8-4243-919d-cfc856e34912 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001700 Aug 03 10:37:15.472000 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 3 10:37:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:37:16.017046 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-79e05f3b-eaf6-4de6-b01c-b2010e2fb869 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:37:16.036270 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-79e05f3b-eaf6-4de6-b01c-b2010e2fb869 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.428139 Aug 03 10:37:16.036817 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Aug 3 10:37:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:37:17.203334 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-9a0924e2-9ed8-4243-919d-cfc856e34912 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:17.204343 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-9a0924e2-9ed8-4243-919d-cfc856e34912 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 03 10:37:17.204741 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 3 10:37:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:37:17.748183 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-58b6df70-42a4-4810-9b40-3e57d14ab35d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:37:17.767358 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-58b6df70-42a4-4810-9b40-3e57d14ab35d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.416721 Aug 03 10:37:17.767894 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Aug 3 10:37:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:37:18.738484 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-9a0924e2-9ed8-4243-919d-cfc856e34912 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:18.739482 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-9a0924e2-9ed8-4243-919d-cfc856e34912 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 03 10:37:18.739879 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 3 10:37:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:37:19.268119 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-f2b9c83a-e656-4437-8f0f-6ba6c8ac6449 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:37:19.287561 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-f2b9c83a-e656-4437-8f0f-6ba6c8ac6449 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.409390 Aug 03 10:37:19.288107 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Aug 3 10:37:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:37:20.261960 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-9a0924e2-9ed8-4243-919d-cfc856e34912 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:20.262952 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-9a0924e2-9ed8-4243-919d-cfc856e34912 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 03 10:37:20.263339 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 3 10:37:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:37:20.796045 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-3ff20ddb-fe2b-49fa-91d1-82a66fa50b88 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:37:20.816803 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-3ff20ddb-fe2b-49fa-91d1-82a66fa50b88 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.407568 Aug 03 10:37:20.817262 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Wed Aug 3 10:37:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:38:12.601235 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-9a0924e2-9ed8-4243-919d-cfc856e34912 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:38:12.602406 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-9a0924e2-9ed8-4243-919d-cfc856e34912 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001635 Aug 03 10:38:12.602799 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 930 bytes} [Wed Aug 3 10:38:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:38:12.613593 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:38:12.994134 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-6df92892-8763-4666-ade4-2e74aa85cf1c admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:38:13.014233 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-6df92892-8763-4666-ade4-2e74aa85cf1c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405166 Aug 03 10:38:13.014777 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Aug 3 10:38:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:38:13.035789 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG dbcounter [-] [109880] Writing DB stats nova_api:SELECT=14 {{(pid=109880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:38:13.039641 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-104369aa-0975-464d-a7a8-687d043b0b89 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:38:13.047794 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-104369aa-0975-464d-a7a8-687d043b0b89 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013405 Aug 03 10:38:13.048323 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1282 bytes} [Wed Aug 3 10:38:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:38:13.060029 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-80a7f114-79b4-4fa2-8afd-f11048f2365e admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:38:13.067765 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-80a7f114-79b4-4fa2-8afd-f11048f2365e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011403 Aug 03 10:38:13.068280 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1285 bytes} [Wed Aug 3 10:38:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:38:13.080165 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-c1120bd8-4d65-4416-b0da-7790caa15ce2 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:38:13.089035 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-c1120bd8-4d65-4416-b0da-7790caa15ce2 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012917 Aug 03 10:38:13.089588 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1285 bytes} [Wed Aug 3 10:38:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:38:13.101739 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-d26e00fa-d1a5-4088-b817-a3bbdbc44037 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:38:13.109867 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-d26e00fa-d1a5-4088-b817-a3bbdbc44037 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011950 Aug 03 10:38:13.110381 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1282 bytes} [Wed Aug 3 10:38:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:41:32.291686 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-c1120bd8-4d65-4416-b0da-7790caa15ce2 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:41:32.292717 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-c1120bd8-4d65-4416-b0da-7790caa15ce2 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 03 10:41:32.293130 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 3 10:41:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:41:32.450485 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_api:SELECT=6 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:41:32.608058 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-67aab7e5-9072-47ec-8787-56697865356d admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:41:32.612291 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 10:41:32.612291 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: warnings.warn(msg) Aug 03 10:41:32.612291 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-67aab7e5-9072-47ec-8787-56697865356d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:41:32.612291 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-67aab7e5-9072-47ec-8787-56697865356d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:41:32.612912 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-67aab7e5-9072-47ec-8787-56697865356d admin admin] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:41:32.613342 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-67aab7e5-9072-47ec-8787-56697865356d admin admin] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:41:32.647981 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-67aab7e5-9072-47ec-8787-56697865356d admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.206126 Aug 03 10:41:32.648546 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 3 10:41:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:41:33.504244 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-c1120bd8-4d65-4416-b0da-7790caa15ce2 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:41:33.505260 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-c1120bd8-4d65-4416-b0da-7790caa15ce2 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 03 10:41:33.505691 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 3 10:41:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:41:33.704138 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-e1e2c5f1-ad46-4fdf-844a-2748ab982c6a admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:41:33.706559 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 10:41:33.706559 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: warnings.warn(msg) Aug 03 10:41:33.707845 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-e1e2c5f1-ad46-4fdf-844a-2748ab982c6a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:41:33.708341 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-e1e2c5f1-ad46-4fdf-844a-2748ab982c6a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:41:33.709084 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-e1e2c5f1-ad46-4fdf-844a-2748ab982c6a admin admin] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:41:33.709531 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-e1e2c5f1-ad46-4fdf-844a-2748ab982c6a admin admin] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:41:33.729583 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-e1e2c5f1-ad46-4fdf-844a-2748ab982c6a admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085002 Aug 03 10:41:33.730157 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 3 10:41:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:41:44.965363 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-c1120bd8-4d65-4416-b0da-7790caa15ce2 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:41:44.966493 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-c1120bd8-4d65-4416-b0da-7790caa15ce2 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001713 Aug 03 10:41:44.967097 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 3 10:41:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:41:45.112560 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_cell0:SELECT=4 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:41:45.113281 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_cell1:SELECT=4 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:41:45.113899 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG dbcounter [-] [109881] Writing DB stats nova_api:SELECT=8 {{(pid=109881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:41:45.161673 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-66eac888-555c-44bf-b181-35096d59d20f admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:41:45.164055 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 10:41:45.164055 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: warnings.warn(msg) Aug 03 10:41:45.165240 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-66eac888-555c-44bf-b181-35096d59d20f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:41:45.165733 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-66eac888-555c-44bf-b181-35096d59d20f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:41:45.166563 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-66eac888-555c-44bf-b181-35096d59d20f admin admin] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:41:45.166986 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-66eac888-555c-44bf-b181-35096d59d20f admin admin] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:41:45.194977 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-66eac888-555c-44bf-b181-35096d59d20f admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087320 Aug 03 10:41:45.195541 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 38/74] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 3 10:41:45 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:41:46.022884 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: DEBUG nova.api.openstack.wsgi [None req-c1120bd8-4d65-4416-b0da-7790caa15ce2 admin admin] Calling method '>' {{(pid=109880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:41:46.023877 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: INFO nova.api.openstack.requestlog [None req-c1120bd8-4d65-4416-b0da-7790caa15ce2 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Aug 03 10:41:46.024272 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: [pid: 109880|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 3 10:41:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:41:46.215249 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG nova.api.openstack.wsgi [None req-42ee3fec-54e9-4546-b281-7125dc9ae1d8 admin admin] Calling method '>' {{(pid=109881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:41:46.217685 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 10:41:46.217685 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: warnings.warn(msg) Aug 03 10:41:46.218867 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-42ee3fec-54e9-4546-b281-7125dc9ae1d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:41:46.219313 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-42ee3fec-54e9-4546-b281-7125dc9ae1d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:41:46.220090 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-42ee3fec-54e9-4546-b281-7125dc9ae1d8 admin admin] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:41:46.220518 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: DEBUG oslo_concurrency.lockutils [None req-42ee3fec-54e9-4546-b281-7125dc9ae1d8 admin admin] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:41:46.242849 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: INFO nova.api.openstack.requestlog [None req-42ee3fec-54e9-4546-b281-7125dc9ae1d8 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078442 Aug 03 10:41:46.243326 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: [pid: 109881|app: 0|req: 39/76] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 3 10:41:46 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:42:41.284153 dv-cinder-850836-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 03 10:42:41.284692 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: Wed Aug 3 10:42:41 2022 - graceful shutdown triggered... Aug 03 10:42:41.285104 dv-cinder-850836-2-iscsi devstack@n-api.service[109881]: Gracefully killing worker 2 (pid: 109881)... Aug 03 10:42:41.285500 dv-cinder-850836-2-iscsi devstack@n-api.service[109880]: Gracefully killing worker 1 (pid: 109880)... Aug 03 10:42:42.285625 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: worker 1 buried after 1 seconds Aug 03 10:42:42.285625 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: worker 2 buried after 1 seconds Aug 03 10:42:42.286293 dv-cinder-850836-2-iscsi devstack@n-api.service[109879]: goodbye to uWSGI. Aug 03 10:42:42.287214 dv-cinder-850836-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 03 10:42:42.287764 dv-cinder-850836-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 03 10:42:42.290598 dv-cinder-850836-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 10:42:42.302368 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 10:42:42.304067 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 10:42:42 2022] *** Aug 03 10:42:42.304067 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 10:42:42.304067 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 10:42:42.304067 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: nodename: dv-cinder-850836-2-iscsi Aug 03 10:42:42.304067 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: machine: x86_64 Aug 03 10:42:42.304067 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: clock source: unix Aug 03 10:42:42.304067 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: pcre jit disabled Aug 03 10:42:42.304067 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: detected number of CPU cores: 4 Aug 03 10:42:42.304067 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: current working directory: / Aug 03 10:42:42.304067 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: detected binary path: /usr/bin/uwsgi-core Aug 03 10:42:42.304067 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: your processes number limit is 47680 Aug 03 10:42:42.304067 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: your memory page size is 4096 bytes Aug 03 10:42:42.304981 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: detected max file descriptor number: 2048 Aug 03 10:42:42.304981 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: lock engine: pthread robust mutexes Aug 03 10:42:42.304981 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: thunder lock: enabled Aug 03 10:42:42.304981 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 10:42:42.304981 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 10:42:42.344243 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: Python main interpreter initialized at 0x55b237d119c0 Aug 03 10:42:42.344243 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: python threads support enabled Aug 03 10:42:42.344243 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: your server socket listen backlog is limited to 100 connections Aug 03 10:42:42.344243 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: your mercy for graceful operations on workers is 90 seconds Aug 03 10:42:42.344707 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 10:42:42.344707 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: *** Operational MODE: preforking *** Aug 03 10:42:42.344977 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: *** uWSGI is running in multiple interpreter mode *** Aug 03 10:42:42.344977 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: spawned uWSGI master process (pid: 124369) Aug 03 10:42:42.345188 dv-cinder-850836-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 03 10:42:42.345823 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: spawned uWSGI worker 1 (pid: 124388, cores: 1) Aug 03 10:42:42.346337 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: spawned uWSGI worker 2 (pid: 124389, cores: 1) Aug 03 10:42:42.346549 dv-cinder-850836-2-iscsi devstack@n-api.service[124369]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 10:42:43.014997 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 10:42:43.015775 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 10:42:44.187509 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 10:42:44.187509 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: from cryptography.utils import int_from_bytes Aug 03 10:42:44.188265 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 10:42:44.188265 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: from cryptography.utils import int_from_bytes Aug 03 10:42:44.206954 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 10:42:44.206954 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: from cryptography.utils import int_from_bytes Aug 03 10:42:44.207579 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 10:42:44.207579 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: from cryptography.utils import int_from_bytes Aug 03 10:42:46.663504 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 10:42:46.664162 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 10:42:46.664256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 10:42:46.664578 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 10:42:46.665032 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 10:42:46.665438 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.665799 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.666129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.666455 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.666950 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.667430 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.667946 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.668283 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.668648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.668893 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.669218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.669586 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-2-iscsi {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.669920 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.670400 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.670719 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.671214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.671682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.672188 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.672514 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.673027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.673790 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.674343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.674842 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.675206 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.675518 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.675838 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.676169 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.676285 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 10:42:46.677307 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.677402 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 10:42:46.677711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.677816 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 10:42:46.677898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.678004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 10:42:46.678152 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-2-iscsi {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.678439 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.678709 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 10:42:46.678824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.679072 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.679500 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.679680 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.679818 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.680141 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.680451 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.680550 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.680800 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.681118 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.681295 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.681450 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.681799 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.682077 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.682184 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.682443 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.682754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.682905 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.683068 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.683386 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.683635 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.683739 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.684011 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.684325 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.684476 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.684587 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.684881 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.685211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.685337 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.685561 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.685893 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.686151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.686267 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.686403 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.686731 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.686958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.687081 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.687361 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.687675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.687847 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.687968 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.688780 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.688780 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.688967 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.689191 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.689555 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-2-iscsi {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.689711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.689835 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.689944 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.690160 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.690489 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.690804 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.690921 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.691127 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.691224 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.691486 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.691591 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.691774 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.691920 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.692177 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.692507 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.692719 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.693032 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.693160 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.693357 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.693455 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.693700 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.693812 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.694025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.694152 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.694361 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.694483 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.694694 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.695014 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.695272 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.695390 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.695598 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.695717 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.695916 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.696040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.696635 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.696730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-2-iscsi {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.696989 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.697310 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.697663 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.697852 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.698279 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.698376 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.698467 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.698542 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.698700 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.698844 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.699112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.699379 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.699496 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.699725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.699934 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.700034 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.700116 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.700373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.700474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.700692 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.700792 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.701004 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.701110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.701317 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.701441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.701669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.701988 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.702253 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.702354 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.702583 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.702686 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.702904 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.703068 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.703212 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.703364 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.703521 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.703671 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.703819 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.703970 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.704112 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.704262 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.704405 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.704592 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.704749 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.704957 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.705113 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.705271 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.705426 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.705609 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.705762 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.705913 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.706096 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.706298 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.706457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.706609 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.706752 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.706903 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.707415 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.707591 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.708476 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.708642 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.708787 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.708931 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.709072 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.709329 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.709517 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.709685 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.710110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.710267 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.710423 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.710567 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.710709 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.710987 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.711301 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.711466 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.711825 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.712107 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.712262 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.712426 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.712570 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.712724 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.712874 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.713036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.713192 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.713336 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.713512 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.713663 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.713817 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.713959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.714112 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.714271 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.714449 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.714602 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.714602 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.714889 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.715095 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.715249 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.715391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.715540 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.715540 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.715829 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.715980 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.716130 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.716130 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.716437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.716591 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.716743 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.716743 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.717030 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.717536 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.717693 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.717847 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.718001 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.718153 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.718297 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.718608 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.718766 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.718916 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.719074 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.719225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.719462 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.719612 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.719762 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.719912 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.720068 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.720211 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.720352 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.720500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.720641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.720790 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.720790 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.721162 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.721319 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.721493 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.721642 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.721795 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.721971 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.722116 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.722269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.722422 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.722564 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.722714 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.722867 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.723019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.723177 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.723427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.724094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.724253 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.724396 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.724538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.724694 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.724838 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.724978 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.725855 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.726011 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.726171 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.726370 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.726556 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.726725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.726915 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.727063 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.727429 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.727729 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.727883 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.728025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.728198 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.728380 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.728703 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.728855 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.729005 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.729295 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.729525 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.729688 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.730096 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.730326 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.730480 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.730675 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.730842 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.730999 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.731323 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.731473 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.731641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.731789 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.731939 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.732108 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.732262 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.732481 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.732645 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.732789 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.732946 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.733175 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.733334 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.733527 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.733689 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.733832 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.733973 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.734133 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.734292 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.734434 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.734610 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.734757 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.734936 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.734936 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.735224 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.735224 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.735502 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.735502 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.735835 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 10:42:46.736021 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.736186 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.736345 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.736487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.736636 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.736780 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.736937 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.737112 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.737267 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.737836 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.738005 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.738171 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.738326 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.738477 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.738856 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.739160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.739307 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.739551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.739757 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.739907 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.740057 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.740199 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.740355 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.740506 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.740657 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.740806 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.740961 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.740961 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.741238 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.741531 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.741685 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.741867 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.742046 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.742270 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.742424 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.742587 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.742731 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.742872 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.743026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.743181 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.743323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.743473 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.743624 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.743773 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.743953 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.744109 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.744252 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.744403 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.744403 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.744680 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.744829 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.744971 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.745142 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.745293 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.745443 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.745624 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.745818 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.745965 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.746119 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.746262 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.746410 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.746559 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.746708 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.746858 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.747024 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.747167 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.747324 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.747489 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.747820 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.748149 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.748307 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.748450 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.748678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.748843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.749136 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.749295 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.749600 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.749763 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.749915 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.750064 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.750206 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.750373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.750702 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.750860 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.751012 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.751161 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.751311 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.751483 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.751723 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.751870 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.752031 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.752213 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.752357 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.752513 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.752657 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.752798 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.752939 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.753079 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.753233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.753381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.753601 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.753773 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.753926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.754086 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.754237 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.754378 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.754521 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.754724 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.754873 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.755020 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.755182 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.755331 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.755485 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.755641 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.755829 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.755992 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.756196 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.756349 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.756505 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.756661 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.756811 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.756971 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.757129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.757284 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.757441 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.757614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.757928 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.758244 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.758421 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.758570 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.758726 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.758875 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.759160 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.759325 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.759486 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.759635 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.759783 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.759932 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.759932 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.760261 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.760261 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.760570 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.760570 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.760860 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.761016 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.761174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.761330 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.761512 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.761676 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.761930 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.762094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.762245 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.762400 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.762555 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.762715 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.762864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.763026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.763176 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.763331 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.763486 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.763642 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.763790 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.764024 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.764184 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.764332 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.764480 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.764627 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.764967 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.765143 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.765305 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.765478 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.765646 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.765802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.766895 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.767053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.767205 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.767361 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.767535 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.767687 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.767991 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.768349 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.768510 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.768659 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.768807 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.768964 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.769265 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.769423 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.769608 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.769772 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.769929 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.770079 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.770781 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.770956 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.771114 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.771269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.771426 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.771585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.771742 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.771914 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.772154 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.772351 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.772514 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.772677 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.772826 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.772973 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.773132 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.773291 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.773442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.773628 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.773786 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.773934 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.774081 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.774228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.774375 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.774532 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.774681 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.774835 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.774991 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.775150 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.775307 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.775463 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.775611 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.775759 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.775966 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.776126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.776290 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.776479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.776633 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.776788 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.776937 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.777084 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.777252 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.777401 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.777619 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.777771 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.777923 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.778229 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.778540 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.778705 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.778864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.779012 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.779160 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.779430 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.779542 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.779642 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.779732 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.779817 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.779924 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.780007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.780101 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.780187 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.780272 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.780362 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.780448 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.780534 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.780620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.780703 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.780794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.780884 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.780957 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.781073 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.781171 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.781258 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.781341 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.781423 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.781561 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.781679 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.781763 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.781849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.781939 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.782024 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.782115 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.782198 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.782269 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.782338 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.782421 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.782511 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.782609 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.782695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.782778 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.782860 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.782951 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.783035 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.783127 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.783218 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.783310 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.783394 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.783476 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.783565 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.783663 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.783748 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.783838 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.783931 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.784015 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.784112 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.784206 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.784299 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.784299 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.784460 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.784539 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.784632 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.784724 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.784816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.784900 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.784983 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.785066 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.785159 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.785244 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.785326 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.785408 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.785507 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.785606 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.785702 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.785788 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.785911 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.786542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.786618 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.786701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.786784 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.786866 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.786956 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.787049 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.787135 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.787217 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.787308 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.787584 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.787686 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.787790 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.787876 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.787982 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.788125 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.788208 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.788291 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.788365 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.788435 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.788520 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.788602 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.788674 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.788768 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.788862 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.788948 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.789031 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.789122 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.789207 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.789304 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.789385 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.789457 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.789586 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.789697 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.789796 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.789883 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.789975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.790062 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.790148 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.790240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.790334 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.790424 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.790508 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.790591 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.790682 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.790767 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.790860 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.790946 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.791039 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.791124 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.791208 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.791299 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.791393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.791478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.791569 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.791655 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.791745 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.791902 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.791991 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.792075 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.792166 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.792251 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.792332 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.792418 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.792505 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.792584 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.792667 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.792750 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.792833 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.792925 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.793011 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.793095 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.793178 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.793268 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.793361 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.793456 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.793557 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.793653 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.793653 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.793821 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.793920 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.794006 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.794098 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.794270 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.794374 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.794593 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.794699 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.794917 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.795021 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.795242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.795346 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.795577 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.795688 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.795891 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.795993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.796202 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.796296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.796519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.796693 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.796832 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.796932 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.797142 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.797236 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.797449 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.797586 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.797782 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.797902 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.798087 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.798189 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.798396 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.798490 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.798706 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.798807 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.799018 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.799110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.799322 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.799423 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.799633 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.799743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.799940 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.800041 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.800247 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.800346 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.800559 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.800666 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.800863 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.800963 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.801171 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.801263 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.801528 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.801643 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.801860 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.801972 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.802172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.802275 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.802480 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.802586 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.802786 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.802888 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.803095 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.803190 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.803405 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.803532 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.803715 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.803808 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.804027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.804119 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.804335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.804439 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.804643 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.804737 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.804950 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.805049 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.805259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.805352 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.805598 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.805722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.805926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.806021 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.806236 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.806329 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.806544 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.806644 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.806849 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.806951 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.807157 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.807265 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.807465 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.807567 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.807779 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.807901 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.808092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.808192 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.808403 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.808492 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.808715 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.808818 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.809021 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.809115 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.809331 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.809423 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.809664 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.809770 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.809982 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.810076 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.810296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.810398 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.810604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.810698 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.810910 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.811004 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.811222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.811316 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.811536 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.811652 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.811839 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.811936 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.812153 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.812247 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.812461 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.812556 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.812776 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.812867 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.813081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.813180 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.813388 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.813509 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.813757 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.813849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.814070 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.814175 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.814387 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.814481 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.814691 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.814782 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.815005 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.815107 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.815320 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.815420 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.815628 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.815721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.815936 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.816038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.816248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.816342 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.816555 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.816654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.816863 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.816970 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.817208 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.817316 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.817556 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.817675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.817872 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.817975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.818177 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.818270 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.818487 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.818586 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.818795 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.818883 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.819101 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.819194 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.819408 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.819497 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.819719 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.819809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.820025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.820115 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.820331 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.820421 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.820638 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.820733 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.820946 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.821077 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.821253 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.821402 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.821601 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.821745 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.821914 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.822058 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.822222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.822375 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.822528 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.822696 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.822840 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.823016 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.823175 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.823335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.823487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.823646 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.823849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.824071 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.824172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.824389 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.824485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.824705 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.824810 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.825022 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.825116 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.825336 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.825447 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.825672 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.825769 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.825992 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.826094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.826325 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.826424 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.826635 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.826735 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.826946 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.827059 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.827256 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.827349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.827581 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.827678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.827878 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.827986 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.828193 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.828286 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.828508 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.828609 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.828832 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.828943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.829157 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.829259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.829498 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.829660 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.829812 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.829979 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.830127 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.830297 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.830446 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.830626 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.830781 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.830954 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.831049 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.831284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.831379 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.831595 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.831703 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.831915 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.832008 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.832232 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.832324 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.832562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.832665 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.833407 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.833508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.833757 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.833860 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.834071 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.834168 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.834382 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.834474 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.834687 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.834780 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.835015 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.835110 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.835331 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.835435 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.835639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.835733 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.835950 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.836069 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.836262 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.836403 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.836577 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.836724 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.836887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.837054 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.837323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.837418 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.837664 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.837771 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.837980 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.838082 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.838290 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.838430 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.838607 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.838722 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.838915 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.839019 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.839233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.839325 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.839549 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.839655 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.839856 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.839996 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.840173 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.840281 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.840487 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.840589 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.840801 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.840905 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.841114 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.841222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.841441 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.841600 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.841774 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.841870 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.842102 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.842207 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.842421 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.842518 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.842733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.842827 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.843042 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.843146 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.843352 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.843446 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.843677 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.843769 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.843985 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.844086 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.844294 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.844393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.844603 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.844705 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.844915 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.845009 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.845265 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.845360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.845603 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.845756 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.845930 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.846073 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.846265 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.846388 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.846598 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.846701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.846914 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.847029 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.847252 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.847345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.847587 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.847765 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.847911 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.848016 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.848234 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.848343 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.849121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.849250 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.849440 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.849600 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.849774 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.849868 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.850091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.850203 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.850403 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.850506 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.850712 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.850813 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.851025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.851123 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.851338 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.851433 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.851647 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.851743 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.851957 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.852086 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.852264 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.852419 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.852591 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.852744 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.852884 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.853078 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.853214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.853403 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.853550 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.853741 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.853851 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.854053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.854148 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.854372 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.854475 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.854685 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.855034 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.855256 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.855352 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.855585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.855687 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.855897 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.855994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.856213 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.856315 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.856530 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.856631 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.856842 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.856939 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.857153 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.857255 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.857480 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.857588 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.857811 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.857915 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.858121 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.858216 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.858449 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.858553 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.858769 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.858863 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.859090 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.859230 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.859487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.859610 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.859708 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.859853 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.860032 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.860136 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.860348 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.860456 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.860657 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.860760 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.860967 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.861221 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.861315 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.861584 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.861683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.861911 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.862007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.862234 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.862341 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.862555 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.862650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.862877 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.862978 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.863201 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.863302 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.863517 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.863618 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.863834 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.863946 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.864175 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.864279 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.864493 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.864594 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.864818 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.864912 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.865129 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.865238 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.865437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.865587 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.865774 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.865879 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.866084 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.866188 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.866394 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.866490 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.866703 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.866823 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.867015 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.867119 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.867323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.867417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.867633 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.867742 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.867939 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.868035 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.868263 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.868357 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.868572 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.868681 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.868896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.868999 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.869207 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.869349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.869628 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.869752 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.869842 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.869937 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.870142 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.870246 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.870487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.870592 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.870797 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.870899 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.871112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.871211 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.871429 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.871532 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.871753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.871845 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.872090 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.872192 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.872403 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.872499 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.872719 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.872811 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.873039 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.873142 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.873358 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.873459 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.873701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.873916 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.874061 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.874241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.874337 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.874581 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.874683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.874913 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.875020 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.875240 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.875341 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.875561 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.875661 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.875880 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.875972 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.876204 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.876307 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.876517 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.876759 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.876854 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.877095 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.877199 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.877419 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.877598 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.877764 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.877858 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.878080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.878184 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.878394 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.878535 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.878708 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.878830 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.879023 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.879116 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.879340 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.879478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.879771 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.879953 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.880060 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.880309 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.880442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.880633 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.880736 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.880987 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.881096 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.881293 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.881431 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.881637 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.881734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.881962 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.882062 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.882281 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.882373 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.882592 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.882686 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.882909 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.883011 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.883231 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.883325 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.883550 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.883653 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.883861 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.883963 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.884172 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.884273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.884490 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.884592 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.884804 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.884904 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.885117 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.885212 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.885431 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.885602 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.885768 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.885870 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.886081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.886182 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.886404 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.886515 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.886703 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.886798 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.887012 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.887112 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.887331 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.887433 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.887644 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.887746 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.887953 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.888049 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.888263 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.888365 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.888572 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.888666 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.888889 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.888981 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.889198 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.889426 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.889595 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.889797 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.889945 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.890143 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.890246 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.890451 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.890533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.890765 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.890871 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.891115 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.891208 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.891443 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.891536 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.891751 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.891843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.892061 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.892160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.892381 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.892476 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.892699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.892818 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.893017 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.893121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.893329 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.893423 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.893682 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.893790 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.894002 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.894097 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.894317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.894410 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.894643 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.894932 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.895034 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.895820 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.896034 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.896138 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.896393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.896502 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.896718 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.896814 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.897052 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.897147 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.897401 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.897534 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.897725 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.897827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.898052 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.898152 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.898367 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.898461 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.898684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.898826 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.898997 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.899117 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.899314 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.899408 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.899629 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.899722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.899941 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.900022 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.900251 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.900357 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.900565 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.900692 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.900881 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.901017 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.901192 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.901288 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.901523 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.901620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.901838 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.901950 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.902151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.902258 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.902465 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.902567 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.902771 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.902877 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.903082 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.903177 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.903399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.903502 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.903712 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.903816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.904021 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.904117 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.904330 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.904472 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.904637 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.904735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.904955 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.905057 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.905265 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.905360 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.905606 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.905704 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.905918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.906013 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.906235 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.906337 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.906545 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.906649 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.906854 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.906955 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.907215 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.907316 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.907546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.907650 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.907857 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.907952 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.908165 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.908344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.908486 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.908589 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.908833 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.908933 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.909160 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.909263 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.909486 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.909583 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.909833 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.909926 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.910151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.910301 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.910485 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.910579 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.910852 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.911716 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.911882 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.912051 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.912271 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.912398 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.912605 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.912706 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.912953 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.913056 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.913301 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.913395 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.913695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.913810 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.913961 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.914056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.914272 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.914365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.914579 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.914679 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.914895 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.914991 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.915204 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.915298 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.915513 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.915621 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.915823 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.915917 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.916131 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.916226 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.916445 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.916548 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.916752 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.916844 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.917062 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.917155 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.917373 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.917522 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.917709 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.917803 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.918020 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.918127 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.918328 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.918424 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.918639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.918732 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.918946 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.919040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.919256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.919353 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.919566 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.919660 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.919880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.920022 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.920189 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.920296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.920524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.920623 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.920848 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.920941 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.921168 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.921264 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.921496 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.921733 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.921875 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.921983 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.922118 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.922217 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.922465 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.922581 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.922763 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.922873 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.923082 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.923176 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.923399 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.923492 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.923714 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.923818 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.924051 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.924146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.924367 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.924469 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.924684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.924786 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.924999 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.925094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.925315 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.925415 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.925657 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.925769 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.925973 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.926067 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.926308 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.926436 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.926669 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.926827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.926976 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.927072 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.927306 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.927411 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.927630 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.927733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.927955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.928048 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.928269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.928406 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.928577 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.928670 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.928894 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.929006 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.929643 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.929782 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.929782 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.929972 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.929972 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.930161 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.930262 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.930349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.930451 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.930533 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.930969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.931079 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.931177 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.931271 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.931364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.931450 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.931639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.931752 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.931949 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.932055 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.932265 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.932368 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.932575 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.932677 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.932884 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.932996 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.933196 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.933306 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.933528 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.933649 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.933841 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.933943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.934147 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.934247 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.934462 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.934565 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.934811 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.934916 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.935078 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.935181 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.935570 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.935692 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.935789 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.935882 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.935975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.936061 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 10:42:46.936311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.936651 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.936972 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.937299 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.937667 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.937966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.938279 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.938606 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.938932 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.939253 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.939568 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.939904 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.940220 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.940536 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.941500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.941500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.941500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.942039 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.942162 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.942470 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.942767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.943093 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.943423 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.943753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.944061 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.944377 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.944709 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.945023 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.945338 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.945677 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.945992 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.946307 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.946627 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.946948 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.947253 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.947572 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.947891 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.948220 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.948551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.948865 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.949260 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.949546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.949902 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.950222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.950570 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.950940 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.951217 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.951532 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.951843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 10:42:46.952089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 10:42:46.997920 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO dbcounter [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] Registered counter for database nova_api Aug 03 10:42:47.015500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO dbcounter [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] Registered counter for database nova_api Aug 03 10:42:47.019155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_db.sqlalchemy.engines [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:42:47.026836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writer thread running {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:42:47.038019 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_db.sqlalchemy.engines [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124389) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:42:47.045307 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writer thread running {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:42:47.084977 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.context [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4d171320-82a2-402f-aa25-567d87407a2a(cell1) {{(pid=124388) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 10:42:47.089159 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:42:47.090809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:42:47.091616 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:42:47.093656 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:42:47.095654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO dbcounter [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] Registered counter for database nova_cell0 Aug 03 10:42:47.100414 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO dbcounter [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] Registered counter for database nova_cell1 Aug 03 10:42:47.102828 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.context [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4d171320-82a2-402f-aa25-567d87407a2a(cell1) {{(pid=124389) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 10:42:47.107341 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:42:47.108547 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_db.sqlalchemy.engines [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:42:47.108984 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:42:47.109846 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:42:47.109965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_db.sqlalchemy.engines [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:42:47.111858 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:42:47.114447 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO dbcounter [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] Registered counter for database nova_cell0 Aug 03 10:42:47.117338 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writer thread running {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:42:47.118699 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writer thread running {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:42:47.119146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO dbcounter [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] Registered counter for database nova_cell1 Aug 03 10:42:47.129101 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_db.sqlalchemy.engines [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124389) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:42:47.129101 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_db.sqlalchemy.engines [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124389) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:42:47.135861 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writer thread running {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:42:47.137956 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writer thread running {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:42:47.271985 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO dbcounter [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] Registered counter for database nova_cell0 Aug 03 10:42:47.278928 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_db.sqlalchemy.engines [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:42:47.284420 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writer thread running {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:42:47.290711 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO dbcounter [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] Registered counter for database nova_cell0 Aug 03 10:42:47.299652 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_db.sqlalchemy.engines [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124389) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 10:42:47.304854 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writer thread running {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 10:42:47.613595 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: WARNING keystonemiddleware.auth_token [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 10:42:47.620910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: WARNING keystonemiddleware.auth_token [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 10:42:47.651700 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: WARNING keystonemiddleware.auth_token [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 10:42:47.659555 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: WARNING keystonemiddleware.auth_token [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 10:42:47.970924 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: WARNING keystonemiddleware.auth_token [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 10:42:47.976965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: WARNING keystonemiddleware.auth_token [None req-303d7816-f3b0-415a-9ad7-1a2c688295dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 10:42:47.982584 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b237d119c0 pid: 124388 (default app) Aug 03 10:42:48.006413 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: WARNING keystonemiddleware.auth_token [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 10:42:48.012410 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: WARNING keystonemiddleware.auth_token [None req-e67320b5-f981-4582-9124-c9f33b97e95e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 10:42:48.017865 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b237d119c0 pid: 124389 (default app) Aug 03 10:43:34.693853 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:43:34.701310 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:43:34.703306 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:43:34.704777 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:43:37.092059 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a21d962c-b315-4e98-9924-4ad59f21d9ec tempest-VolumesGetTestJSON-1714550588 tempest-VolumesGetTestJSON-1714550588-project] Action: 'create', calling method: .version_select at 0x7fbd12599040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-303633361", "metadata": {"Type": "work"}}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:43:38.965976 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a21d962c-b315-4e98-9924-4ad59f21d9ec tempest-VolumesGetTestJSON-1714550588 tempest-VolumesGetTestJSON-1714550588-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.299709 Aug 03 10:43:38.966636 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Aug 3 10:43:34 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4308 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 03 10:43:39.832970 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9d068e99-73e7-462e-a1c9-f644cfd39198 tempest-VolumesGetTestJSON-1714550588 tempest-VolumesGetTestJSON-1714550588-project] Calling method '.version_select at 0x7fbd126f80d0>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:43:39.917061 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=3 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:43:39.918221 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=3 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:43:39.920274 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=3 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:43:39.922410 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=3 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:43:40.360556 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9d068e99-73e7-462e-a1c9-f644cfd39198 tempest-VolumesGetTestJSON-1714550588 tempest-VolumesGetTestJSON-1714550588-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/b9cfe01e-74e6-49b7-83d1-985995c920e0" status: 200 len: 353 microversion: 2.1 time: 1.375530 Aug 03 10:43:40.361308 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 1/2] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 3 10:43:38 2022] GET /compute/v2.1/os-volumes/b9cfe01e-74e6-49b7-83d1-985995c920e0 => generated 353 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:43:40.381056 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f155427a-6dba-4c0b-a826-f68a2ea7b1e9 tempest-VolumesGetTestJSON-1714550588 tempest-VolumesGetTestJSON-1714550588-project] Calling method '.version_select at 0x7fbd12495ee0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:43:40.532413 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f155427a-6dba-4c0b-a826-f68a2ea7b1e9 tempest-VolumesGetTestJSON-1714550588 tempest-VolumesGetTestJSON-1714550588-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/b9cfe01e-74e6-49b7-83d1-985995c920e0" status: 200 len: 353 microversion: 2.1 time: 0.159909 Aug 03 10:43:40.533170 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 3 10:43:40 2022] GET /compute/v2.1/os-volumes/b9cfe01e-74e6-49b7-83d1-985995c920e0 => generated 353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:43:40.553941 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2ecf9565-2e40-4940-acd4-fde8eb480692 tempest-VolumesGetTestJSON-1714550588 tempest-VolumesGetTestJSON-1714550588-project] Calling method '.version_select at 0x7fbd124caee0>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:43:40.671397 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2ecf9565-2e40-4940-acd4-fde8eb480692 tempest-VolumesGetTestJSON-1714550588 tempest-VolumesGetTestJSON-1714550588-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/b9cfe01e-74e6-49b7-83d1-985995c920e0" status: 202 len: 0 microversion: 2.1 time: 0.121752 Aug 03 10:43:40.672685 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 3 10:43:40 2022] DELETE /compute/v2.1/os-volumes/b9cfe01e-74e6-49b7-83d1-985995c920e0 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:43:40.685585 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-66ce95e0-bc67-4b40-bad1-5031688a8936 tempest-VolumesGetTestJSON-1714550588 tempest-VolumesGetTestJSON-1714550588-project] Calling method '.version_select at 0x7fbd124ab5e0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:43:40.917599 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-66ce95e0-bc67-4b40-bad1-5031688a8936 tempest-VolumesGetTestJSON-1714550588 tempest-VolumesGetTestJSON-1714550588-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/b9cfe01e-74e6-49b7-83d1-985995c920e0" status: 200 len: 352 microversion: 2.1 time: 0.238367 Aug 03 10:43:40.933617 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 3/5] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 3 10:43:40 2022] GET /compute/v2.1/os-volumes/b9cfe01e-74e6-49b7-83d1-985995c920e0 => generated 352 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:43:41.944720 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c27c552d-b6b3-4820-9667-070e3a6cda45 tempest-VolumesGetTestJSON-1714550588 tempest-VolumesGetTestJSON-1714550588-project] Calling method '.version_select at 0x7fbd124caa60>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:43:42.541148 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-c27c552d-b6b3-4820-9667-070e3a6cda45 tempest-VolumesGetTestJSON-1714550588 tempest-VolumesGetTestJSON-1714550588-project] HTTP exception thrown: Volume b9cfe01e-74e6-49b7-83d1-985995c920e0 could not be found. Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c27c552d-b6b3-4820-9667-070e3a6cda45 tempest-VolumesGetTestJSON-1714550588 tempest-VolumesGetTestJSON-1714550588-project] Request method failure captured: Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/os-volumes/b9cfe01e-74e6-49b7-83d1-985995c920e0 HTTP/1.1 Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lFW0KVwcdwDHRZRO0p06K0oILg8RgCWY2mO4jHda9eJE6CkUxy9WnQIOCpMiIplO9dxHKVOl3OhFf-e7mO3xwzwpDh6iMFTL-J2kvRiGNFabkhKNuIU2DvSzr3yjdl4f2P7O5fIOVqw694RI0iZ2trQbbbYpHCJwZgOiB8wC_uFecY Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: fd27e5fc185c4d8e8dd91eb172c8257a Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-VolumesGetTestJSON-1714550588 Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:43:42.553546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:43:42.555755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fd27e5fc185c4d8e8dd91eb172c8257a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fd27e5fc185c4d8e8dd91eb172c8257a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fd27e5fc185c4d8e8dd91eb172c8257a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fd27e5fc185c4d8e8dd91eb172c8257a", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:43:42.555755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-VolumesGetTestJSON-1714550588 Aug 03 10:43:42.555755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: fd27e5fc185c4d8e8dd91eb172c8257a Aug 03 10:43:42.555755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-VolumesGetTestJSON-1714550588 Aug 03 10:43:42.555755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-VolumesGetTestJSON-1714550588-project Aug 03 10:43:42.555755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:43:42.555755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:43:42.555755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: d743784ca49c4cce8bd9bddba9b19925 Aug 03 10:43:42.555755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-VolumesGetTestJSON-1714550588-project Aug 03 10:43:42.555755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: Aug 03 10:43:42.555755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Volume b9cfe01e-74e6-49b7-83d1-985995c920e0 could not be found. Aug 03 10:43:42.555755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': 'b9cfe01e-74e6-49b7-83d1-985995c920e0'} Aug 03 10:43:42.555755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b9cfe01e-74e6-49b7-83d1-985995c920e0 could not be found. (HTTP 404) (Request-ID: req-5fa9f6f0-4dfc-4a0e-9acd-6d9a95845cf5) Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:43:42.557216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 10:43:42.561056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b9cfe01e-74e6-49b7-83d1-985995c920e0 could not be found. Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 10:43:42.565918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:43:42.569055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b9cfe01e-74e6-49b7-83d1-985995c920e0 could not be found. Aug 03 10:43:42.569055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:43:42.569055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:43:42.569055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:43:42.569055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:43:42.569055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:43:42.569055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:43:42.569055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:43:42.569055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:43:42.569055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b9cfe01e-74e6-49b7-83d1-985995c920e0 could not be found. Aug 03 10:43:42.569055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:43:42.569055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c27c552d-b6b3-4820-9667-070e3a6cda45 tempest-VolumesGetTestJSON-1714550588 tempest-VolumesGetTestJSON-1714550588-project] Returning 404 to user: Volume b9cfe01e-74e6-49b7-83d1-985995c920e0 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:43:42.594811 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c27c552d-b6b3-4820-9667-070e3a6cda45 tempest-VolumesGetTestJSON-1714550588 tempest-VolumesGetTestJSON-1714550588-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/b9cfe01e-74e6-49b7-83d1-985995c920e0" status: 404 len: 109 microversion: 2.1 time: 0.659085 Aug 03 10:43:42.613836 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 3/6] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 3 10:43:41 2022] GET /compute/v2.1/os-volumes/b9cfe01e-74e6-49b7-83d1-985995c920e0 => generated 109 bytes in 680 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:43:50.301503 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f42badfe-a854-4fdb-903d-722f5c64a2a9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Action: 'create', calling method: .version_select at 0x7fbd124abb80>, body: {"keypair": {"name": "tempest-keypair-1777545104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZYfRXxlWoetVk1EgOGol/nVQV25M7JgbR++cgcjyGuftGtt+ZGIeI3ixxCFBYKRAoPnFmWpJgCIOhtfoddIE+L5knsz704mEQdGumecCDwhLFDbqYnboERZDumqkbRKQ=="}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:43:50.454974 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-f42badfe-a854-4fdb-903d-722f5c64a2a9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Getting quotas for project bcfc3e09588c48299fdf5634cda57416. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:43:50.471265 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-f42badfe-a854-4fdb-903d-722f5c64a2a9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Getting quotas for user ebdb81686d804eb3864b97481643fc2b and project bcfc3e09588c48299fdf5634cda57416. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:43:50.625679 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f42badfe-a854-4fdb-903d-722f5c64a2a9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.600903 Aug 03 10:43:50.628357 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 4/7] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 3 10:43:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:43:54.591779 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-8b158ecd-bc9f-4c69-9cb3-4dbd8806ea28 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Action: 'create', calling method: .version_select at 0x7fbd12cef9d0>, body: {"keypair": {"name": "tempest-keypair-1166748933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbozVijFFXOqwRDI9JYSCX3ea6iiPtQSvscA4U6uRQ7PHlV2IZ/tXMM8sebgv27SKaxHQhHjgmME6VnEYOKyTFHfYw3fYOO1TQJnv6vPnmDmX0x0XCmLz3Pus9TYfOaSw=="}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:43:54.793404 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-8b158ecd-bc9f-4c69-9cb3-4dbd8806ea28 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for project 40540f8322a54133bc32e1af000810ad. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:43:54.812646 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-8b158ecd-bc9f-4c69-9cb3-4dbd8806ea28 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for user 956aff831fa04d29ba5cffb88e73f4d2 and project 40540f8322a54133bc32e1af000810ad. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:43:54.980380 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-8b158ecd-bc9f-4c69-9cb3-4dbd8806ea28 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.490126 Aug 03 10:43:54.985026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 4/8] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 3 10:43:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:44:00.387035 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-934544546", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc3a73d1-f127-40ea-a3ea-562e46bab0d8"}], "security_groups": [{"name": "tempest-securitygroup--1051478922"}], "key_name": "tempest-keypair-1777545104", "user_data": "}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:00.537699 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=4 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:00.737220 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-862647989", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42fc3d27-55c9-4201-9ee3-9a52a8c6af61"}], "security_groups": [{"name": "tempest-securitygroup--1971516993"}], "key_name": "tempest-keypair-1166748933", "user_data": "}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:01.544569 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] validate_networks() for [('bc3a73d1-f127-40ea-a3ea-562e46bab0d8', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:44:02.369257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.network.neutron [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] validate_networks() for [('42fc3d27-55c9-4201-9ee3-9a52a8c6af61', None, None, None, None, None)] {{(pid=124389) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:44:04.854454 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=4 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:06.208978 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Flavor limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:44:06.209991 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Image limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:44:06.209991 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Flavor pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:44:06.210308 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Image pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:44:06.210884 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:44:06.227268 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:06.227972 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:06.229388 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:06.230216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:06.332685 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for project 40540f8322a54133bc32e1af000810ad. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:44:06.369671 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for user 956aff831fa04d29ba5cffb88e73f4d2 and project 40540f8322a54133bc32e1af000810ad. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:44:06.425371 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:44:06.426537 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:44:06.426640 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Going to run 1 instances... {{(pid=124389) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:44:06.426914 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:44:06.427537 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:44:06.430322 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:44:06.441096 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:44:06.451946 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:06.481956 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:06.484736 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:06.489665 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:06.571634 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-18feb510-095a-4e86-8c49-4f91cc7eea87 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.842339 Aug 03 10:44:06.579222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 5/9] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:44:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 5851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:44:06.619066 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Getting quotas for project bcfc3e09588c48299fdf5634cda57416. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:44:06.649208 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Getting quotas for user ebdb81686d804eb3864b97481643fc2b and project bcfc3e09588c48299fdf5634cda57416. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:44:06.746416 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:44:06.775270 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:44:07.072646 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-12e7eda6-e04a-484d-b187-978893b58238 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.698445 Aug 03 10:44:07.073286 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 5/10] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:44:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 6700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:44:07.209775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-330963088", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "networks": [{"uuid": "8ad11ed0-f950-4189-bd1a-6e6e4dc24f73"}]}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:07.370385 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.network.neutron [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] validate_networks() for [('8ad11ed0-f950-4189-bd1a-6e6e4dc24f73', None, None, None, None, None)] {{(pid=124389) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:44:07.574216 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3ea94e90-f3fc-42e0-9e1b-711c55b631d4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Action: 'create', calling method: .version_select at 0x7fbd11b743a0>, body: {"keypair": {"name": "tempest-keypair-1148531242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGB2xvzwuRuwpu8OkXIP/w3x02+s09XXpAj2iBVTf7Clj9tqwe2f1ksgCIA+wUa+01WsNh1PbkQNGVJndvedxc6VoC5FXYzwWS3BQBhEBIc2bteNOm4+AhKsVScDvx3XHg=="}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:07.620953 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-3ea94e90-f3fc-42e0-9e1b-711c55b631d4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Getting quotas for project 157914bad58e4c50b92dfca14ec638aa. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:44:07.635140 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-3ea94e90-f3fc-42e0-9e1b-711c55b631d4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Getting quotas for user 5744cccc5a224263b71c052dc783e103 and project 157914bad58e4c50b92dfca14ec638aa. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:44:07.716976 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3ea94e90-f3fc-42e0-9e1b-711c55b631d4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.636251 Aug 03 10:44:07.725689 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 6/11] 10.222.0.47 () {62 vars in 1200 bytes} [Wed Aug 3 10:44:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 646 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 10:44:07.733874 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a701a1c6-c71b-4526-b1f1-1cb9524c4284 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:07.742499 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a701a1c6-c71b-4526-b1f1-1cb9524c4284 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:07.936037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a701a1c6-c71b-4526-b1f1-1cb9524c4284 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:07.970615 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a701a1c6-c71b-4526-b1f1-1cb9524c4284 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1241 microversion: 2.1 time: 0.242021 Aug 03 10:44:07.986095 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 7/12] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:07 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1241 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:08.003252 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4ff69b8c-850f-47ec-af4f-07a9f82f4d2d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:08.004905 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4ff69b8c-850f-47ec-af4f-07a9f82f4d2d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:08.195809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4ff69b8c-850f-47ec-af4f-07a9f82f4d2d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:08.217252 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4ff69b8c-850f-47ec-af4f-07a9f82f4d2d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1237 microversion: 2.1 time: 0.229388 Aug 03 10:44:08.241063 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 8/13] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:07 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1237 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:08.613331 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Flavor limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:44:08.614125 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Image limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:44:08.615217 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Flavor pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:44:08.616019 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Image pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:44:08.617034 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:44:08.691084 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:08.691938 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:08.693507 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:08.694330 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:08.826507 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Getting quotas for project ab735db52f2e420e9aeba9387484dd07. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:44:08.857864 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Getting quotas for user d560ec3b091c4baab93c4abb5fabd287 and project ab735db52f2e420e9aeba9387484dd07. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:44:08.883546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Going to run 1 instances... {{(pid=124389) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:44:08.885800 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:44:09.118697 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-6e1b4e5a-b952-4560-87e4-119c09983b31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.535885 Aug 03 10:44:09.122238 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 6/14] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:44:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:44:09.146995 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d037ce4a-3e9e-46fc-8a66-19e5878849b2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:09.154620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d037ce4a-3e9e-46fc-8a66-19e5878849b2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:09.446374 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d037ce4a-3e9e-46fc-8a66-19e5878849b2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:09.532820 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d037ce4a-3e9e-46fc-8a66-19e5878849b2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1241 microversion: 2.1 time: 0.404685 Aug 03 10:44:09.538324 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 7/15] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:09 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1241 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:09.577756 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-fd3543b8-9379-42cc-9169-cdded0014d43 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:09.579709 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-fd3543b8-9379-42cc-9169-cdded0014d43 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:09.806649 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1175699722", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:10.010805 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] validate_networks() for [('680d69ed-4b8e-41f5-b67c-6ab15f91ea47', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:44:10.076642 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fd3543b8-9379-42cc-9169-cdded0014d43 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:10.099665 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-fd3543b8-9379-42cc-9169-cdded0014d43 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1214 microversion: 2.1 time: 0.555107 Aug 03 10:44:10.101018 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:09 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1214 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:10.111720 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c282ea2e-c9dc-4f0b-b06b-ae7eca3cf719 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:10.114656 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-c282ea2e-c9dc-4f0b-b06b-ae7eca3cf719 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:10.602125 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c282ea2e-c9dc-4f0b-b06b-ae7eca3cf719 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:10.612914 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c282ea2e-c9dc-4f0b-b06b-ae7eca3cf719 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1237 microversion: 2.1 time: 0.510395 Aug 03 10:44:10.617099 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 9/17] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:10 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1237 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:10.628004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-f59f57f1-79d9-4c73-85fd-4d693bb66a80 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:10.630328 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-f59f57f1-79d9-4c73-85fd-4d693bb66a80 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:10.643479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f59f57f1-79d9-4c73-85fd-4d693bb66a80 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:10.647360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f59f57f1-79d9-4c73-85fd-4d693bb66a80 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:10.650944 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f59f57f1-79d9-4c73-85fd-4d693bb66a80 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:10.651705 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f59f57f1-79d9-4c73-85fd-4d693bb66a80 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:11.053544 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f59f57f1-79d9-4c73-85fd-4d693bb66a80 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:11.072632 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-f59f57f1-79d9-4c73-85fd-4d693bb66a80 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1245 microversion: 2.1 time: 0.453921 Aug 03 10:44:11.074227 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 10/18] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:10 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1245 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:11.138309 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e68666e4-8533-4477-b92b-e4db283d3d91 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:11.142852 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e68666e4-8533-4477-b92b-e4db283d3d91 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:11.167063 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e68666e4-8533-4477-b92b-e4db283d3d91 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:11.169101 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e68666e4-8533-4477-b92b-e4db283d3d91 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:11.170372 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e68666e4-8533-4477-b92b-e4db283d3d91 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:11.174546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e68666e4-8533-4477-b92b-e4db283d3d91 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:11.523737 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e68666e4-8533-4477-b92b-e4db283d3d91 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:11.561922 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e68666e4-8533-4477-b92b-e4db283d3d91 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1218 microversion: 2.1 time: 0.426961 Aug 03 10:44:11.564716 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 11/19] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:11 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1218 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:44:11.644428 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9b09083c-0910-48cf-9d2f-947ed44e26cc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:11.647721 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9b09083c-0910-48cf-9d2f-947ed44e26cc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:11.693212 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b09083c-0910-48cf-9d2f-947ed44e26cc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:11.697219 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b09083c-0910-48cf-9d2f-947ed44e26cc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:11.704083 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b09083c-0910-48cf-9d2f-947ed44e26cc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:11.707892 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b09083c-0910-48cf-9d2f-947ed44e26cc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:11.973328 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9b09083c-0910-48cf-9d2f-947ed44e26cc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:12.013869 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9b09083c-0910-48cf-9d2f-947ed44e26cc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1241 microversion: 2.1 time: 0.374503 Aug 03 10:44:12.017801 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 12/20] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:11 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1241 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:44:12.025105 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:44:12.026079 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:44:12.026235 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:44:12.026771 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:44:12.027367 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:44:12.046702 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:12.047324 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:12.048904 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:12.052842 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:12.100813 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e3dde490-0ebf-49a3-aa79-13799127ff07 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:12.102884 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e3dde490-0ebf-49a3-aa79-13799127ff07 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:12.104971 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Getting quotas for project ca8789771e8a4505866424b6c7748291. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:44:12.114079 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Getting quotas for user a5e714aad25f4fda8acf767ad7e2490b and project ca8789771e8a4505866424b6c7748291. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:44:12.119565 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e3dde490-0ebf-49a3-aa79-13799127ff07 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:12.120062 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e3dde490-0ebf-49a3-aa79-13799127ff07 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:12.121773 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e3dde490-0ebf-49a3-aa79-13799127ff07 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:12.122363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e3dde490-0ebf-49a3-aa79-13799127ff07 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:12.137875 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:44:12.144992 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:44:12.289223 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-37bd006d-7c99-4ee8-9965-b28b6a9bb4a4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.046269 Aug 03 10:44:12.290520 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 9/21] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:44:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 4049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:44:12.312244 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d4686cad-02f4-49c8-afdc-b88007a77bf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:12.322658 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d4686cad-02f4-49c8-afdc-b88007a77bf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:12.433596 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e3dde490-0ebf-49a3-aa79-13799127ff07 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:12.546885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d4686cad-02f4-49c8-afdc-b88007a77bf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:12.558596 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d4686cad-02f4-49c8-afdc-b88007a77bf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1222 microversion: 2.1 time: 0.253374 Aug 03 10:44:12.560712 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 10/22] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:12 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1222 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:12.586898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ff6dba21-1d8f-4fdd-af8e-d2057651c264 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:12.588603 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ff6dba21-1d8f-4fdd-af8e-d2057651c264 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:12.604330 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e3dde490-0ebf-49a3-aa79-13799127ff07 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1245 microversion: 2.1 time: 0.485823 Aug 03 10:44:12.614089 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ff6dba21-1d8f-4fdd-af8e-d2057651c264 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:12.620946 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 13/23] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:12 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1245 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:12.624707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ff6dba21-1d8f-4fdd-af8e-d2057651c264 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:12.626277 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ff6dba21-1d8f-4fdd-af8e-d2057651c264 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:12.628362 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ff6dba21-1d8f-4fdd-af8e-d2057651c264 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:13.048672 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6b58c1fb-9db1-4acf-9405-698f29d563e0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:13.064934 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6b58c1fb-9db1-4acf-9405-698f29d563e0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:13.096918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6b58c1fb-9db1-4acf-9405-698f29d563e0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:13.097827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6b58c1fb-9db1-4acf-9405-698f29d563e0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:13.107960 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6b58c1fb-9db1-4acf-9405-698f29d563e0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:13.108812 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6b58c1fb-9db1-4acf-9405-698f29d563e0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:13.350036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ff6dba21-1d8f-4fdd-af8e-d2057651c264 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:13.375068 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ff6dba21-1d8f-4fdd-af8e-d2057651c264 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1274 microversion: 2.1 time: 0.792246 Aug 03 10:44:13.399770 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 11/24] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:12 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1274 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:13.413413 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1103629768", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:13.668649 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] validate_networks() for [('680d69ed-4b8e-41f5-b67c-6ab15f91ea47', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:44:13.864052 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-6b58c1fb-9db1-4acf-9405-698f29d563e0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:13.886164 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-6b58c1fb-9db1-4acf-9405-698f29d563e0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1289 microversion: 2.1 time: 0.847334 Aug 03 10:44:13.887249 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 14/25] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:13 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1289 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:13.913135 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-50a29d21-d355-4df2-8e53-d74632185059 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:13.929076 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-50a29d21-d355-4df2-8e53-d74632185059 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:13.963900 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-50a29d21-d355-4df2-8e53-d74632185059 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:13.964621 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-50a29d21-d355-4df2-8e53-d74632185059 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:13.965900 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-50a29d21-d355-4df2-8e53-d74632185059 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:13.966572 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-50a29d21-d355-4df2-8e53-d74632185059 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:14.495905 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-50a29d21-d355-4df2-8e53-d74632185059 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:14.531218 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-50a29d21-d355-4df2-8e53-d74632185059 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1301 microversion: 2.1 time: 0.635885 Aug 03 10:44:14.549204 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 15/26] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:13 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1301 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:14.599988 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1fe1f54d-b249-43b7-9ca4-8ca79da0cda2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:14.600631 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-1fe1f54d-b249-43b7-9ca4-8ca79da0cda2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:14.636209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1fe1f54d-b249-43b7-9ca4-8ca79da0cda2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:14.636840 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1fe1f54d-b249-43b7-9ca4-8ca79da0cda2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:14.637722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1fe1f54d-b249-43b7-9ca4-8ca79da0cda2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:14.638168 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1fe1f54d-b249-43b7-9ca4-8ca79da0cda2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:15.129207 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1fe1f54d-b249-43b7-9ca4-8ca79da0cda2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:15.139475 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1fe1f54d-b249-43b7-9ca4-8ca79da0cda2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1272 microversion: 2.1 time: 0.588301 Aug 03 10:44:15.142335 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 16/27] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:14 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1272 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:15.177418 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-40ffed14-f3e1-4285-ac4d-808c56fc6f8d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:15.178633 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-40ffed14-f3e1-4285-ac4d-808c56fc6f8d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:15.190162 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-40ffed14-f3e1-4285-ac4d-808c56fc6f8d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:15.191448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-40ffed14-f3e1-4285-ac4d-808c56fc6f8d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:15.193334 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-40ffed14-f3e1-4285-ac4d-808c56fc6f8d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:15.197507 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-40ffed14-f3e1-4285-ac4d-808c56fc6f8d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:15.391011 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-40ffed14-f3e1-4285-ac4d-808c56fc6f8d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:15.400893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-40ffed14-f3e1-4285-ac4d-808c56fc6f8d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1295 microversion: 2.1 time: 0.240878 Aug 03 10:44:15.405670 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 17/28] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:15 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1295 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:15.574157 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-fde4f2c7-2881-4773-bacf-e873b8547553 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:15.575020 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-fde4f2c7-2881-4773-bacf-e873b8547553 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:15.592329 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fde4f2c7-2881-4773-bacf-e873b8547553 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:15.594332 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fde4f2c7-2881-4773-bacf-e873b8547553 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:15.597184 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fde4f2c7-2881-4773-bacf-e873b8547553 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:15.599821 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fde4f2c7-2881-4773-bacf-e873b8547553 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:16.901600 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fde4f2c7-2881-4773-bacf-e873b8547553 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:16.925459 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:44:16.927136 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:44:16.927275 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:44:16.927657 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:44:16.928151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:44:16.943281 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-fde4f2c7-2881-4773-bacf-e873b8547553 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1299 microversion: 2.1 time: 1.362415 Aug 03 10:44:16.951099 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 18/29] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:15 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1299 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:16.959302 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:16.960825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:16.968223 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:16.970942 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:16.995790 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-642270797", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8d3428d-2295-4a36-ab41-2839e9ef181a"}], "security_groups": [{"name": "tempest-securitygroup--842026800"}], "key_name": "tempest-keypair-1148531242", "user_data": "}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:17.064168 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Getting quotas for project ca8789771e8a4505866424b6c7748291. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:44:17.095915 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Getting quotas for user a5e714aad25f4fda8acf767ad7e2490b and project ca8789771e8a4505866424b6c7748291. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:44:17.142920 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:44:17.152313 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:44:17.318274 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4390c262-46ff-4503-80f3-8f97b4cf70d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.917081 Aug 03 10:44:17.325743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 12/30] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:44:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 3925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:44:17.336218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c016fe27-268e-4091-9e86-13e1226a717c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:17.337312 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c016fe27-268e-4091-9e86-13e1226a717c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:17.364846 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c016fe27-268e-4091-9e86-13e1226a717c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:17.365617 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c016fe27-268e-4091-9e86-13e1226a717c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:17.367017 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c016fe27-268e-4091-9e86-13e1226a717c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:17.367668 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c016fe27-268e-4091-9e86-13e1226a717c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:18.042718 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.network.neutron [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] validate_networks() for [('d8d3428d-2295-4a36-ab41-2839e9ef181a', None, None, None, None, None)] {{(pid=124389) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:44:18.459778 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c016fe27-268e-4091-9e86-13e1226a717c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:18.491642 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c016fe27-268e-4091-9e86-13e1226a717c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1272 microversion: 2.1 time: 1.164666 Aug 03 10:44:18.497480 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 13/31] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:17 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1272 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:18.520869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a977ec76-bff0-46d4-966f-833259c8c4e4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:18.523148 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a977ec76-bff0-46d4-966f-833259c8c4e4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:18.552387 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a977ec76-bff0-46d4-966f-833259c8c4e4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:18.554889 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a977ec76-bff0-46d4-966f-833259c8c4e4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:18.559270 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a977ec76-bff0-46d4-966f-833259c8c4e4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:18.561244 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a977ec76-bff0-46d4-966f-833259c8c4e4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:18.752154 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=4 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:19.139782 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a977ec76-bff0-46d4-966f-833259c8c4e4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:19.170746 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a977ec76-bff0-46d4-966f-833259c8c4e4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1295 microversion: 2.1 time: 0.669432 Aug 03 10:44:19.172104 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 14/32] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:18 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1295 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:19.192844 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9d1c3003-3b75-47d6-a167-a042071325b7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:19.193780 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9d1c3003-3b75-47d6-a167-a042071325b7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:19.208497 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9d1c3003-3b75-47d6-a167-a042071325b7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:19.213499 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9d1c3003-3b75-47d6-a167-a042071325b7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:19.215071 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9d1c3003-3b75-47d6-a167-a042071325b7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:19.216058 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9d1c3003-3b75-47d6-a167-a042071325b7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:19.566143 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9d1c3003-3b75-47d6-a167-a042071325b7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:19.598108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9d1c3003-3b75-47d6-a167-a042071325b7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1218 microversion: 2.1 time: 0.419322 Aug 03 10:44:19.610007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 15/33] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:19 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1218 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:19.621924 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0cd028ed-15c4-4187-8879-c4298810141b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:19.631678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0cd028ed-15c4-4187-8879-c4298810141b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:19.652975 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0cd028ed-15c4-4187-8879-c4298810141b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:19.654467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0cd028ed-15c4-4187-8879-c4298810141b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:19.658618 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0cd028ed-15c4-4187-8879-c4298810141b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:19.659431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0cd028ed-15c4-4187-8879-c4298810141b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:20.607768 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=18 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:20.708145 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0cd028ed-15c4-4187-8879-c4298810141b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:20.749979 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0cd028ed-15c4-4187-8879-c4298810141b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1299 microversion: 2.1 time: 1.136890 Aug 03 10:44:20.755388 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 16/34] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:19 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1299 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:20.780067 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4452432f-be70-475f-9b66-d380d942a3fe tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:20.781885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4452432f-be70-475f-9b66-d380d942a3fe tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:20.787108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=11 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:20.805316 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4452432f-be70-475f-9b66-d380d942a3fe tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:20.807390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4452432f-be70-475f-9b66-d380d942a3fe tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:20.809925 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4452432f-be70-475f-9b66-d380d942a3fe tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:20.811741 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4452432f-be70-475f-9b66-d380d942a3fe tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:21.085558 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4452432f-be70-475f-9b66-d380d942a3fe tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:21.138086 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4452432f-be70-475f-9b66-d380d942a3fe tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1272 microversion: 2.1 time: 0.378043 Aug 03 10:44:21.153510 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 17/35] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:20 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1272 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:21.174160 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-dd6093e3-f98b-41e1-b2c8-b2d9bdd6636d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:21.178553 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-dd6093e3-f98b-41e1-b2c8-b2d9bdd6636d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:21.218545 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dd6093e3-f98b-41e1-b2c8-b2d9bdd6636d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:21.219838 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dd6093e3-f98b-41e1-b2c8-b2d9bdd6636d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:21.221420 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dd6093e3-f98b-41e1-b2c8-b2d9bdd6636d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:21.225701 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dd6093e3-f98b-41e1-b2c8-b2d9bdd6636d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:21.868082 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-dd6093e3-f98b-41e1-b2c8-b2d9bdd6636d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:21.883843 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-dd6093e3-f98b-41e1-b2c8-b2d9bdd6636d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1295 microversion: 2.1 time: 0.736875 Aug 03 10:44:21.885138 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 18/36] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:21 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1295 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:21.901784 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6d12b0ff-ec49-4085-8e97-d47423d73eb7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:21.902774 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6d12b0ff-ec49-4085-8e97-d47423d73eb7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:21.920119 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d12b0ff-ec49-4085-8e97-d47423d73eb7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:21.921150 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d12b0ff-ec49-4085-8e97-d47423d73eb7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:21.922770 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d12b0ff-ec49-4085-8e97-d47423d73eb7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:21.923460 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d12b0ff-ec49-4085-8e97-d47423d73eb7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:22.067339 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6d12b0ff-ec49-4085-8e97-d47423d73eb7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:22.095538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6d12b0ff-ec49-4085-8e97-d47423d73eb7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1280 microversion: 2.1 time: 0.205056 Aug 03 10:44:22.096474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 19/37] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:21 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1280 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:22.115556 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3e0f7db0-9ac2-4e06-ad3c-f7016161b0a9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:22.116661 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3e0f7db0-9ac2-4e06-ad3c-f7016161b0a9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:22.137645 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3e0f7db0-9ac2-4e06-ad3c-f7016161b0a9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:22.138134 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3e0f7db0-9ac2-4e06-ad3c-f7016161b0a9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:22.139056 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3e0f7db0-9ac2-4e06-ad3c-f7016161b0a9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:22.139759 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3e0f7db0-9ac2-4e06-ad3c-f7016161b0a9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:22.432331 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Flavor limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:44:22.433045 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Image limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:44:22.433879 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Flavor pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:44:22.434435 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Image pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:44:22.435126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:44:22.484739 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3e0f7db0-9ac2-4e06-ad3c-f7016161b0a9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:22.484964 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:22.485588 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:22.486989 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:22.487712 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:22.517081 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3e0f7db0-9ac2-4e06-ad3c-f7016161b0a9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1367 microversion: 2.1 time: 0.417495 Aug 03 10:44:22.518337 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 20/38] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:22 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:22.554185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4e0dbd01-01d3-4c9b-a8cf-72a884b13e27 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:22.555230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4e0dbd01-01d3-4c9b-a8cf-72a884b13e27 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:22.575157 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e0dbd01-01d3-4c9b-a8cf-72a884b13e27 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:22.575507 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e0dbd01-01d3-4c9b-a8cf-72a884b13e27 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:22.576407 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e0dbd01-01d3-4c9b-a8cf-72a884b13e27 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:22.577035 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e0dbd01-01d3-4c9b-a8cf-72a884b13e27 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:22.589665 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Getting quotas for project 157914bad58e4c50b92dfca14ec638aa. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:44:22.595801 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Getting quotas for user 5744cccc5a224263b71c052dc783e103 and project 157914bad58e4c50b92dfca14ec638aa. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:44:22.620723 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Going to run 1 instances... {{(pid=124389) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:44:22.627416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:44:22.712360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-857c4fcc-13a3-478e-9dd6-a54a9d36d201 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.751612 Aug 03 10:44:22.714452 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 19/39] 10.222.0.47 () {62 vars in 1188 bytes} [Wed Aug 3 10:44:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 5759 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 10:44:22.727845 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-7f5584f4-ea19-456c-9aad-75f3baeef186 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:22.728509 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-7f5584f4-ea19-456c-9aad-75f3baeef186 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:22.834184 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7f5584f4-ea19-456c-9aad-75f3baeef186 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:22.843361 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7f5584f4-ea19-456c-9aad-75f3baeef186 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:22.844976 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7f5584f4-ea19-456c-9aad-75f3baeef186 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:22.846239 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-7f5584f4-ea19-456c-9aad-75f3baeef186 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1281 microversion: 2.20 time: 0.123135 Aug 03 10:44:22.862143 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 20/40] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:22 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1281 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:22.894935 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4e0dbd01-01d3-4c9b-a8cf-72a884b13e27 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:22.912062 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-88ff4fa9-fd71-4bcc-bf99-abd2783ad2be tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:22.912897 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-88ff4fa9-fd71-4bcc-bf99-abd2783ad2be tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:22.916666 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:22.920515 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4e0dbd01-01d3-4c9b-a8cf-72a884b13e27 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 0.388287 Aug 03 10:44:22.921738 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 21/41] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:22 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:22.924863 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-88ff4fa9-fd71-4bcc-bf99-abd2783ad2be tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:22.926058 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-88ff4fa9-fd71-4bcc-bf99-abd2783ad2be tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:22.927222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-88ff4fa9-fd71-4bcc-bf99-abd2783ad2be tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:22.928119 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-88ff4fa9-fd71-4bcc-bf99-abd2783ad2be tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:23.124093 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-93f96015-77fa-42b7-9991-a207606421d9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:23.124715 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-93f96015-77fa-42b7-9991-a207606421d9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:23.132309 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-88ff4fa9-fd71-4bcc-bf99-abd2783ad2be tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:23.134578 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-93f96015-77fa-42b7-9991-a207606421d9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:23.136658 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-93f96015-77fa-42b7-9991-a207606421d9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:23.143299 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-93f96015-77fa-42b7-9991-a207606421d9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:23.144321 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-93f96015-77fa-42b7-9991-a207606421d9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:23.154423 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-88ff4fa9-fd71-4bcc-bf99-abd2783ad2be tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 0.250244 Aug 03 10:44:23.168979 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 21/42] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:22 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:23.252231 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-93f96015-77fa-42b7-9991-a207606421d9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:23.262975 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-93f96015-77fa-42b7-9991-a207606421d9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1280 microversion: 2.1 time: 0.142761 Aug 03 10:44:23.263743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 22/43] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:23 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1280 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:44:23.554730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9b67661f-126a-4be4-b9aa-bf4a0019b5da tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:23.555579 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9b67661f-126a-4be4-b9aa-bf4a0019b5da tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:23.563275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b67661f-126a-4be4-b9aa-bf4a0019b5da tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:23.563861 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b67661f-126a-4be4-b9aa-bf4a0019b5da tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:23.567324 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b67661f-126a-4be4-b9aa-bf4a0019b5da tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:23.568373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b67661f-126a-4be4-b9aa-bf4a0019b5da tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:23.871693 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d3d99528-5ff6-45ad-b068-1092705b0da3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:23.872324 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d3d99528-5ff6-45ad-b068-1092705b0da3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:23.881508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d3d99528-5ff6-45ad-b068-1092705b0da3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:23.882300 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d3d99528-5ff6-45ad-b068-1092705b0da3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:23.883539 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d3d99528-5ff6-45ad-b068-1092705b0da3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:23.884159 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d3d99528-5ff6-45ad-b068-1092705b0da3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:23.943050 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9b67661f-126a-4be4-b9aa-bf4a0019b5da tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:23.953976 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9b67661f-126a-4be4-b9aa-bf4a0019b5da tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1367 microversion: 2.1 time: 0.403731 Aug 03 10:44:23.954729 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 22/44] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:23 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:44:23.966090 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1c4c9288-ce7e-4c86-aee4-6bae0044df69 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:23.973329 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-1c4c9288-ce7e-4c86-aee4-6bae0044df69 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:23.983738 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1c4c9288-ce7e-4c86-aee4-6bae0044df69 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:23.990079 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1c4c9288-ce7e-4c86-aee4-6bae0044df69 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:23.991972 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1c4c9288-ce7e-4c86-aee4-6bae0044df69 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:23.992921 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1c4c9288-ce7e-4c86-aee4-6bae0044df69 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:24.009988 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d3d99528-5ff6-45ad-b068-1092705b0da3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:24.025277 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d3d99528-5ff6-45ad-b068-1092705b0da3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:24.027012 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d3d99528-5ff6-45ad-b068-1092705b0da3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:24.029623 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d3d99528-5ff6-45ad-b068-1092705b0da3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1285 microversion: 2.20 time: 0.160725 Aug 03 10:44:24.030875 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 23/45] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:23 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:24.178807 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4bf65c43-bf9f-4de2-b06a-83eab0d1dbe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:24.189817 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4bf65c43-bf9f-4de2-b06a-83eab0d1dbe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:24.204462 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4bf65c43-bf9f-4de2-b06a-83eab0d1dbe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:24.206520 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4bf65c43-bf9f-4de2-b06a-83eab0d1dbe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:24.209030 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4bf65c43-bf9f-4de2-b06a-83eab0d1dbe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:24.210147 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4bf65c43-bf9f-4de2-b06a-83eab0d1dbe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:24.261519 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1c4c9288-ce7e-4c86-aee4-6bae0044df69 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:24.281389 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1c4c9288-ce7e-4c86-aee4-6bae0044df69 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 0.323126 Aug 03 10:44:24.283448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 23/46] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:23 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:24.305398 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2eeed38c-6f87-4840-ab85-0fab762f9c1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:24.311590 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2eeed38c-6f87-4840-ab85-0fab762f9c1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:24.333630 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2eeed38c-6f87-4840-ab85-0fab762f9c1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:24.334069 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2eeed38c-6f87-4840-ab85-0fab762f9c1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:24.334916 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2eeed38c-6f87-4840-ab85-0fab762f9c1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:24.335341 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2eeed38c-6f87-4840-ab85-0fab762f9c1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:24.610381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2eeed38c-6f87-4840-ab85-0fab762f9c1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:24.638851 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2eeed38c-6f87-4840-ab85-0fab762f9c1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1280 microversion: 2.1 time: 0.343468 Aug 03 10:44:24.642516 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 24/47] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:24 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1280 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:24.792998 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4bf65c43-bf9f-4de2-b06a-83eab0d1dbe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:24.818742 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4bf65c43-bf9f-4de2-b06a-83eab0d1dbe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 0.643638 Aug 03 10:44:24.820025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 24/48] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:24 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:44:25.003232 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-fa20cc51-ac87-45ed-be39-c51ca637777c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:25.006541 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-fa20cc51-ac87-45ed-be39-c51ca637777c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:25.033362 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fa20cc51-ac87-45ed-be39-c51ca637777c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:25.034392 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fa20cc51-ac87-45ed-be39-c51ca637777c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:25.036152 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fa20cc51-ac87-45ed-be39-c51ca637777c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:25.037396 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fa20cc51-ac87-45ed-be39-c51ca637777c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:25.083916 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f0cd27b0-4382-47cf-8e7e-af094c973bb1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:25.085507 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f0cd27b0-4382-47cf-8e7e-af094c973bb1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:25.151917 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f0cd27b0-4382-47cf-8e7e-af094c973bb1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:25.153539 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f0cd27b0-4382-47cf-8e7e-af094c973bb1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:25.159523 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f0cd27b0-4382-47cf-8e7e-af094c973bb1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:25.164138 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f0cd27b0-4382-47cf-8e7e-af094c973bb1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:25.558709 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f0cd27b0-4382-47cf-8e7e-af094c973bb1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:25.576684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f0cd27b0-4382-47cf-8e7e-af094c973bb1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:25.583073 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f0cd27b0-4382-47cf-8e7e-af094c973bb1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:25.594653 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f0cd27b0-4382-47cf-8e7e-af094c973bb1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1285 microversion: 2.20 time: 0.529883 Aug 03 10:44:25.596816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 25/49] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:25 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1285 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:25.618804 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4e5c97da-1f1a-4eac-b7fc-6625bb79d2e1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:25.628222 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4e5c97da-1f1a-4eac-b7fc-6625bb79d2e1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:25.660998 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e5c97da-1f1a-4eac-b7fc-6625bb79d2e1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:25.661865 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e5c97da-1f1a-4eac-b7fc-6625bb79d2e1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:25.663017 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e5c97da-1f1a-4eac-b7fc-6625bb79d2e1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:25.666221 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e5c97da-1f1a-4eac-b7fc-6625bb79d2e1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:26.226499 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fa20cc51-ac87-45ed-be39-c51ca637777c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:26.235794 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-fa20cc51-ac87-45ed-be39-c51ca637777c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1367 microversion: 2.1 time: 1.245256 Aug 03 10:44:26.260379 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 25/50] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:24 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1367 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:26.277801 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3e9aecfe-60f6-4573-b564-5f1ea02008b5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:26.279107 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3e9aecfe-60f6-4573-b564-5f1ea02008b5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:26.315892 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3e9aecfe-60f6-4573-b564-5f1ea02008b5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:26.320478 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3e9aecfe-60f6-4573-b564-5f1ea02008b5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:26.323411 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3e9aecfe-60f6-4573-b564-5f1ea02008b5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:26.324151 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3e9aecfe-60f6-4573-b564-5f1ea02008b5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:26.794979 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3e9aecfe-60f6-4573-b564-5f1ea02008b5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:26.817983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3e9aecfe-60f6-4573-b564-5f1ea02008b5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1280 microversion: 2.1 time: 0.546475 Aug 03 10:44:26.833135 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 26/51] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:26 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1280 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:26.846497 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-dd7b524e-0e27-4539-9448-acf442cdc83f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:26.850407 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-dd7b524e-0e27-4539-9448-acf442cdc83f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:26.875982 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dd7b524e-0e27-4539-9448-acf442cdc83f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:26.878170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dd7b524e-0e27-4539-9448-acf442cdc83f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:26.884323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dd7b524e-0e27-4539-9448-acf442cdc83f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:26.885196 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dd7b524e-0e27-4539-9448-acf442cdc83f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:26.963239 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=100 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:27.015210 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=6 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:27.131920 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=28 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:27.336319 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4e5c97da-1f1a-4eac-b7fc-6625bb79d2e1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:27.379976 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4e5c97da-1f1a-4eac-b7fc-6625bb79d2e1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 1.779507 Aug 03 10:44:27.393684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 26/52] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:25 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:27.420009 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b3dab996-00da-4758-88f5-3598a8355019 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:27.421180 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b3dab996-00da-4758-88f5-3598a8355019 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:27.481123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b3dab996-00da-4758-88f5-3598a8355019 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:27.482463 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b3dab996-00da-4758-88f5-3598a8355019 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:27.484172 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b3dab996-00da-4758-88f5-3598a8355019 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:27.485211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b3dab996-00da-4758-88f5-3598a8355019 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:27.587380 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:28.432586 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b3dab996-00da-4758-88f5-3598a8355019 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:28.453774 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b3dab996-00da-4758-88f5-3598a8355019 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:28.460664 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b3dab996-00da-4758-88f5-3598a8355019 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:28.467056 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b3dab996-00da-4758-88f5-3598a8355019 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1339 microversion: 2.20 time: 1.070109 Aug 03 10:44:28.468222 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 27/53] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:27 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1339 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:28.479382 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3200f34f-a494-4f2a-a26a-e203ba1a7653 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:28.482622 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3200f34f-a494-4f2a-a26a-e203ba1a7653 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:28.499694 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3200f34f-a494-4f2a-a26a-e203ba1a7653 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:28.510697 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3200f34f-a494-4f2a-a26a-e203ba1a7653 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:28.511464 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3200f34f-a494-4f2a-a26a-e203ba1a7653 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:28.511995 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3200f34f-a494-4f2a-a26a-e203ba1a7653 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:28.899876 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-dd7b524e-0e27-4539-9448-acf442cdc83f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:28.912036 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-dd7b524e-0e27-4539-9448-acf442cdc83f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 2.077381 Aug 03 10:44:28.913588 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 27/54] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:26 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:28.919227 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-51b89154-c601-4bd6-af7c-1466a9d5caf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:28.920118 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-51b89154-c601-4bd6-af7c-1466a9d5caf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:28.929484 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-51b89154-c601-4bd6-af7c-1466a9d5caf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:28.930330 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-51b89154-c601-4bd6-af7c-1466a9d5caf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:28.931597 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-51b89154-c601-4bd6-af7c-1466a9d5caf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:28.932253 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-51b89154-c601-4bd6-af7c-1466a9d5caf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:29.131122 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-51b89154-c601-4bd6-af7c-1466a9d5caf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:29.141196 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-51b89154-c601-4bd6-af7c-1466a9d5caf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1280 microversion: 2.1 time: 0.226209 Aug 03 10:44:29.149311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 28/55] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:28 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1280 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:29.154929 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2fa09e48-905f-4bc9-bb3b-0120678e0e31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:29.168218 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2fa09e48-905f-4bc9-bb3b-0120678e0e31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:29.190248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3200f34f-a494-4f2a-a26a-e203ba1a7653 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:29.194204 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fa09e48-905f-4bc9-bb3b-0120678e0e31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:29.198593 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fa09e48-905f-4bc9-bb3b-0120678e0e31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:29.202130 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fa09e48-905f-4bc9-bb3b-0120678e0e31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:29.204076 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fa09e48-905f-4bc9-bb3b-0120678e0e31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:29.209099 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3200f34f-a494-4f2a-a26a-e203ba1a7653 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1367 microversion: 2.1 time: 0.738610 Aug 03 10:44:29.221496 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 28/56] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:28 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1367 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:29.497804 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8c2b2f08-8175-478e-90c4-5c7625c3986f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:29.498603 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8c2b2f08-8175-478e-90c4-5c7625c3986f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:29.527394 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8c2b2f08-8175-478e-90c4-5c7625c3986f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:29.529992 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8c2b2f08-8175-478e-90c4-5c7625c3986f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:29.533074 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8c2b2f08-8175-478e-90c4-5c7625c3986f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:29.535114 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8c2b2f08-8175-478e-90c4-5c7625c3986f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:30.095433 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8c2b2f08-8175-478e-90c4-5c7625c3986f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:30.135365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8c2b2f08-8175-478e-90c4-5c7625c3986f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:30.143274 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8c2b2f08-8175-478e-90c4-5c7625c3986f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:30.146391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8c2b2f08-8175-478e-90c4-5c7625c3986f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1339 microversion: 2.20 time: 0.657823 Aug 03 10:44:30.193495 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 29/57] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:29 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1339 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:44:30.214639 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-087e49c5-5844-4222-9c40-240a32ce3dc9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:30.218601 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-087e49c5-5844-4222-9c40-240a32ce3dc9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:30.270912 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-087e49c5-5844-4222-9c40-240a32ce3dc9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:30.273320 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-087e49c5-5844-4222-9c40-240a32ce3dc9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:30.276687 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-087e49c5-5844-4222-9c40-240a32ce3dc9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:30.279187 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-087e49c5-5844-4222-9c40-240a32ce3dc9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:30.477035 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2fa09e48-905f-4bc9-bb3b-0120678e0e31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:30.508416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2fa09e48-905f-4bc9-bb3b-0120678e0e31 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 1.355721 Aug 03 10:44:30.511635 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 29/58] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:29 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:30.570816 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-46055296-ed40-401d-ac1d-3463c64f5337 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:30.570816 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-46055296-ed40-401d-ac1d-3463c64f5337 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:30.595724 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-46055296-ed40-401d-ac1d-3463c64f5337 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:30.598786 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-46055296-ed40-401d-ac1d-3463c64f5337 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:30.605732 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-46055296-ed40-401d-ac1d-3463c64f5337 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:30.612602 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-46055296-ed40-401d-ac1d-3463c64f5337 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:31.274876 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-46055296-ed40-401d-ac1d-3463c64f5337 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:31.304984 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-46055296-ed40-401d-ac1d-3463c64f5337 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1280 microversion: 2.1 time: 0.778952 Aug 03 10:44:31.314504 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 30/59] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:30 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1280 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:31.350268 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-185344ef-8646-4631-9b82-9167e2734160 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:31.351344 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-185344ef-8646-4631-9b82-9167e2734160 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:31.372146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-185344ef-8646-4631-9b82-9167e2734160 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:31.372792 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-185344ef-8646-4631-9b82-9167e2734160 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:31.374303 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-185344ef-8646-4631-9b82-9167e2734160 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:31.374986 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-185344ef-8646-4631-9b82-9167e2734160 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:31.626061 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-087e49c5-5844-4222-9c40-240a32ce3dc9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:31.657228 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-087e49c5-5844-4222-9c40-240a32ce3dc9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 1.458497 Aug 03 10:44:31.659913 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 30/60] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:30 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:31.677400 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8c3e02ad-e515-4555-9107-c176f935b8d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:31.678907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8c3e02ad-e515-4555-9107-c176f935b8d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:31.702388 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8c3e02ad-e515-4555-9107-c176f935b8d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:31.703467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8c3e02ad-e515-4555-9107-c176f935b8d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:31.705955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8c3e02ad-e515-4555-9107-c176f935b8d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:31.707501 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8c3e02ad-e515-4555-9107-c176f935b8d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:32.540455 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:32.583912 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-185344ef-8646-4631-9b82-9167e2734160 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:32.603561 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-185344ef-8646-4631-9b82-9167e2734160 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1367 microversion: 2.1 time: 1.272355 Aug 03 10:44:32.604183 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 31/61] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:31 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1367 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:32.616586 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a9bfbe5a-639c-4d73-a8f1-967cc6be8571 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:32.617702 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-a9bfbe5a-639c-4d73-a8f1-967cc6be8571 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:32.652080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9bfbe5a-639c-4d73-a8f1-967cc6be8571 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:32.652461 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9bfbe5a-639c-4d73-a8f1-967cc6be8571 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:32.667504 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9bfbe5a-639c-4d73-a8f1-967cc6be8571 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:32.668096 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9bfbe5a-639c-4d73-a8f1-967cc6be8571 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:32.838593 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=8 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:32.979057 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8c3e02ad-e515-4555-9107-c176f935b8d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:32.997976 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8c3e02ad-e515-4555-9107-c176f935b8d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:33.005086 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8c3e02ad-e515-4555-9107-c176f935b8d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:33.011973 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8c3e02ad-e515-4555-9107-c176f935b8d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1406 microversion: 2.20 time: 1.349287 Aug 03 10:44:33.045394 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 31/62] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:31 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1406 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:33.072696 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fbd14259-f2e8-4fe7-8218-9f547d28419b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:33.085233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fbd14259-f2e8-4fe7-8218-9f547d28419b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:33.134185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fbd14259-f2e8-4fe7-8218-9f547d28419b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:33.140524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fbd14259-f2e8-4fe7-8218-9f547d28419b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:33.145865 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fbd14259-f2e8-4fe7-8218-9f547d28419b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:33.155974 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fbd14259-f2e8-4fe7-8218-9f547d28419b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:34.072664 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-a9bfbe5a-639c-4d73-a8f1-967cc6be8571 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:34.087557 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-a9bfbe5a-639c-4d73-a8f1-967cc6be8571 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 1.477812 Aug 03 10:44:34.090989 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 32/63] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:32 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:34.093119 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-fbd14259-f2e8-4fe7-8218-9f547d28419b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:34.122671 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fbd14259-f2e8-4fe7-8218-9f547d28419b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1322 microversion: 2.1 time: 1.074292 Aug 03 10:44:34.123776 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 32/64] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:33 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1322 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:34.153017 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-21bedb9f-9bfc-4f66-a78e-48b17501fb84 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:34.154821 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-21bedb9f-9bfc-4f66-a78e-48b17501fb84 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:34.204815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-21bedb9f-9bfc-4f66-a78e-48b17501fb84 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:34.206081 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-21bedb9f-9bfc-4f66-a78e-48b17501fb84 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:34.208315 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-21bedb9f-9bfc-4f66-a78e-48b17501fb84 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:34.209691 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-21bedb9f-9bfc-4f66-a78e-48b17501fb84 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:34.314561 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-63dfce93-4aa6-4a7b-a858-75f3a33cbc23 req-455c6306-a5b7-4e52-9952-fd683eea8e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a399a7-91eb-41c8-b408-c5df154a36cc", "tag": "50f0f005-5fa8-46f1-aa89-9825cf666e40"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:34.356025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-63dfce93-4aa6-4a7b-a858-75f3a33cbc23 req-455c6306-a5b7-4e52-9952-fd683eea8e69 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:34.357527 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-63dfce93-4aa6-4a7b-a858-75f3a33cbc23 req-455c6306-a5b7-4e52-9952-fd683eea8e69 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:34.408320 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-63dfce93-4aa6-4a7b-a858-75f3a33cbc23 req-455c6306-a5b7-4e52-9952-fd683eea8e69 service nova] Creating event network-changed:50f0f005-5fa8-46f1-aa89-9825cf666e40 for instance b6a399a7-91eb-41c8-b408-c5df154a36cc on hv-cinder-85083 Aug 03 10:44:34.416020 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-63dfce93-4aa6-4a7b-a858-75f3a33cbc23 req-455c6306-a5b7-4e52-9952-fd683eea8e69 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124389) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 10:44:34.417700 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ebf60442-8bba-4205-b624-66f6c67e2423 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:34.418422 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ebf60442-8bba-4205-b624-66f6c67e2423 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:34.419495 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ebf60442-8bba-4205-b624-66f6c67e2423 None None] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:34.420204 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ebf60442-8bba-4205-b624-66f6c67e2423 None None] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:34.433322 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.compute.rpcapi [None req-ebf60442-8bba-4205-b624-66f6c67e2423 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 10:44:34.434873 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ebf60442-8bba-4205-b624-66f6c67e2423 None None] Releasing lock "compute-rpcapi-router" {{(pid=124389) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 10:44:34.472111 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ebf60442-8bba-4205-b624-66f6c67e2423 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.375180 Aug 03 10:44:34.474789 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 33/65] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:44:34.752480 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-21bedb9f-9bfc-4f66-a78e-48b17501fb84 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:34.771072 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-21bedb9f-9bfc-4f66-a78e-48b17501fb84 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 0.643206 Aug 03 10:44:34.771959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 33/66] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:34 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:34.776958 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-54d74213-c11a-4bf3-bb78-fe1c2bfa8b4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:34.790560 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-54d74213-c11a-4bf3-bb78-fe1c2bfa8b4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:34.801615 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-54d74213-c11a-4bf3-bb78-fe1c2bfa8b4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:34.817523 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-54d74213-c11a-4bf3-bb78-fe1c2bfa8b4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:34.817523 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-54d74213-c11a-4bf3-bb78-fe1c2bfa8b4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:34.817523 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-54d74213-c11a-4bf3-bb78-fe1c2bfa8b4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:34.910553 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-97e3fdc3-dd87-4f56-a0d3-ca9ca102026e req-a15d8b28-36cb-4f32-9a13-0d38d966c1ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da275cd5-e209-45c5-a46e-3082d668a6b5", "tag": "7a2adba4-8abd-4f8c-a020-c7fae10e3050"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:34.939553 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-97e3fdc3-dd87-4f56-a0d3-ca9ca102026e req-a15d8b28-36cb-4f32-9a13-0d38d966c1ee service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:34.942884 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-97e3fdc3-dd87-4f56-a0d3-ca9ca102026e req-a15d8b28-36cb-4f32-9a13-0d38d966c1ee service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:34.973257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-97e3fdc3-dd87-4f56-a0d3-ca9ca102026e req-a15d8b28-36cb-4f32-9a13-0d38d966c1ee service nova] Creating event network-changed:7a2adba4-8abd-4f8c-a020-c7fae10e3050 for instance da275cd5-e209-45c5-a46e-3082d668a6b5 on hv-cinder-85083 Aug 03 10:44:34.984718 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-97e3fdc3-dd87-4f56-a0d3-ca9ca102026e req-a15d8b28-36cb-4f32-9a13-0d38d966c1ee service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.506812 Aug 03 10:44:34.988805 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 34/67] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:44:35.037096 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-809365ef-ceec-4df6-b2de-fc492706ab6e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:35.039705 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-809365ef-ceec-4df6-b2de-fc492706ab6e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:35.062865 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-809365ef-ceec-4df6-b2de-fc492706ab6e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:35.062865 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-809365ef-ceec-4df6-b2de-fc492706ab6e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:35.064155 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-809365ef-ceec-4df6-b2de-fc492706ab6e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:35.065098 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-809365ef-ceec-4df6-b2de-fc492706ab6e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:35.550389 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-54d74213-c11a-4bf3-bb78-fe1c2bfa8b4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:35.577938 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-54d74213-c11a-4bf3-bb78-fe1c2bfa8b4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1367 microversion: 2.1 time: 0.804264 Aug 03 10:44:35.579015 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 34/68] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:34 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1367 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:35.600421 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-127078c0-1659-4b8e-ae58-617425ba1e6c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:35.601640 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-127078c0-1659-4b8e-ae58-617425ba1e6c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:35.625596 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-127078c0-1659-4b8e-ae58-617425ba1e6c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:35.626689 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-127078c0-1659-4b8e-ae58-617425ba1e6c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:35.629370 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-127078c0-1659-4b8e-ae58-617425ba1e6c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:35.630539 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-127078c0-1659-4b8e-ae58-617425ba1e6c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:35.705745 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-809365ef-ceec-4df6-b2de-fc492706ab6e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:35.725150 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-809365ef-ceec-4df6-b2de-fc492706ab6e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:35.733272 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-809365ef-ceec-4df6-b2de-fc492706ab6e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:35.736450 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-809365ef-ceec-4df6-b2de-fc492706ab6e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1406 microversion: 2.20 time: 0.742369 Aug 03 10:44:35.742073 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 35/69] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:34 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1406 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:35.766973 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-f2a89e45-919f-4487-b790-cae5a6727d76 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:35.769118 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-f2a89e45-919f-4487-b790-cae5a6727d76 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:35.781123 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f2a89e45-919f-4487-b790-cae5a6727d76 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:35.782405 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f2a89e45-919f-4487-b790-cae5a6727d76 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:35.784587 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f2a89e45-919f-4487-b790-cae5a6727d76 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:35.786759 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f2a89e45-919f-4487-b790-cae5a6727d76 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:36.122879 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-127078c0-1659-4b8e-ae58-617425ba1e6c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:36.130778 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-127078c0-1659-4b8e-ae58-617425ba1e6c tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 0.550253 Aug 03 10:44:36.131379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 35/70] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:35 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:36.136193 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-76cecb52-b646-497a-8f90-2708b27ca577 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:36.136916 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-76cecb52-b646-497a-8f90-2708b27ca577 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:36.143708 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76cecb52-b646-497a-8f90-2708b27ca577 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:36.144167 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76cecb52-b646-497a-8f90-2708b27ca577 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:36.144981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76cecb52-b646-497a-8f90-2708b27ca577 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:36.145644 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76cecb52-b646-497a-8f90-2708b27ca577 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:36.177271 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f2a89e45-919f-4487-b790-cae5a6727d76 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:36.185571 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-f2a89e45-919f-4487-b790-cae5a6727d76 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1322 microversion: 2.1 time: 0.439555 Aug 03 10:44:36.186241 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 36/71] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:35 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:36.447662 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-76cecb52-b646-497a-8f90-2708b27ca577 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:36.468872 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-76cecb52-b646-497a-8f90-2708b27ca577 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 0.335596 Aug 03 10:44:36.473550 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 36/72] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:36 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:36.503284 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-3c790b5d-87b7-4626-84b2-4d644a6b4a1b req-074b68d6-5ec3-469b-b07c-a32255f5479a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbb281c5-ccf1-4de2-99fb-5201efd51b09", "tag": "908667e2-7286-4600-aa74-6161652b25ca"}, {"name": "network-changed", "server_uuid": "8f8ef6f9-29fe-4627-9bed-212ed8006761", "tag": "e942a2d5-2eea-4a00-b545-1474d8da6cce"}, {"name": "network-changed", "server_uuid": "5895a291-434d-4b7c-85cd-0264cf37f5f3", "tag": "971e4968-4040-4784-a0ed-4c689d9711ff"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:36.546934 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-3c790b5d-87b7-4626-84b2-4d644a6b4a1b req-074b68d6-5ec3-469b-b07c-a32255f5479a service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:36.547722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-3c790b5d-87b7-4626-84b2-4d644a6b4a1b req-074b68d6-5ec3-469b-b07c-a32255f5479a service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:36.619475 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-de2303dc-ed92-4c6e-ac16-f7e960c0491b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:36.625962 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-de2303dc-ed92-4c6e-ac16-f7e960c0491b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:36.672206 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-de2303dc-ed92-4c6e-ac16-f7e960c0491b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:36.673569 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-de2303dc-ed92-4c6e-ac16-f7e960c0491b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:36.674172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-3c790b5d-87b7-4626-84b2-4d644a6b4a1b req-074b68d6-5ec3-469b-b07c-a32255f5479a service nova] Creating event network-changed:908667e2-7286-4600-aa74-6161652b25ca for instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 on hv-cinder-85083 Aug 03 10:44:36.680112 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-3c790b5d-87b7-4626-84b2-4d644a6b4a1b req-074b68d6-5ec3-469b-b07c-a32255f5479a service nova] Creating event network-changed:e942a2d5-2eea-4a00-b545-1474d8da6cce for instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 on hv-cinder-85083 Aug 03 10:44:36.684668 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-3c790b5d-87b7-4626-84b2-4d644a6b4a1b req-074b68d6-5ec3-469b-b07c-a32255f5479a service nova] Creating event network-changed:971e4968-4040-4784-a0ed-4c689d9711ff for instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 on hv-cinder-85083 Aug 03 10:44:36.685042 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-de2303dc-ed92-4c6e-ac16-f7e960c0491b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:36.689497 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-de2303dc-ed92-4c6e-ac16-f7e960c0491b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:36.753433 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-3c790b5d-87b7-4626-84b2-4d644a6b4a1b req-074b68d6-5ec3-469b-b07c-a32255f5479a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.255383 Aug 03 10:44:36.757931 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 37/73] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:44:36.782931 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-92af8a9e-dae2-4ab1-b6fe-c161a034e4ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:36.786019 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-92af8a9e-dae2-4ab1-b6fe-c161a034e4ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:36.817020 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-92af8a9e-dae2-4ab1-b6fe-c161a034e4ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:36.820027 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-92af8a9e-dae2-4ab1-b6fe-c161a034e4ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:36.824091 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-92af8a9e-dae2-4ab1-b6fe-c161a034e4ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:36.826755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-92af8a9e-dae2-4ab1-b6fe-c161a034e4ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:37.150914 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-de2303dc-ed92-4c6e-ac16-f7e960c0491b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:37.172207 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-de2303dc-ed92-4c6e-ac16-f7e960c0491b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1367 microversion: 2.1 time: 0.574949 Aug 03 10:44:37.176690 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 37/74] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:36 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1367 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:37.180809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ac02716a-db20-44cc-8f8f-2ca8e019ecc3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:37.181827 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ac02716a-db20-44cc-8f8f-2ca8e019ecc3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:37.189972 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ac02716a-db20-44cc-8f8f-2ca8e019ecc3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:37.190425 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ac02716a-db20-44cc-8f8f-2ca8e019ecc3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:37.191560 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ac02716a-db20-44cc-8f8f-2ca8e019ecc3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:37.192008 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ac02716a-db20-44cc-8f8f-2ca8e019ecc3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:37.225050 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-92af8a9e-dae2-4ab1-b6fe-c161a034e4ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:37.234043 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-92af8a9e-dae2-4ab1-b6fe-c161a034e4ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:37.235572 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-92af8a9e-dae2-4ab1-b6fe-c161a034e4ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:37.236974 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-92af8a9e-dae2-4ab1-b6fe-c161a034e4ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1406 microversion: 2.20 time: 0.464390 Aug 03 10:44:37.237561 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 38/75] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:36 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1406 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:37.242498 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-a3172285-611e-4fd2-b9a3-a1798ef9ef39 req-7735e973-b8cc-4330-87ed-d28819a548c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffac1966-f7c4-4029-89d1-2d7010eba5da", "tag": "be45d1ac-e48b-4761-bcee-1161cea179a4"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:37.255448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-a3172285-611e-4fd2-b9a3-a1798ef9ef39 req-7735e973-b8cc-4330-87ed-d28819a548c7 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:37.256801 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-a3172285-611e-4fd2-b9a3-a1798ef9ef39 req-7735e973-b8cc-4330-87ed-d28819a548c7 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:37.307884 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-a3172285-611e-4fd2-b9a3-a1798ef9ef39 req-7735e973-b8cc-4330-87ed-d28819a548c7 service nova] Creating event network-changed:be45d1ac-e48b-4761-bcee-1161cea179a4 for instance ffac1966-f7c4-4029-89d1-2d7010eba5da on hv-cinder-85083 Aug 03 10:44:37.327128 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-a3172285-611e-4fd2-b9a3-a1798ef9ef39 req-7735e973-b8cc-4330-87ed-d28819a548c7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085516 Aug 03 10:44:37.328881 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 39/76] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:44:37.343643 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-376050a2-1d00-4b16-9db7-6df016f2a7a3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:37.344348 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-376050a2-1d00-4b16-9db7-6df016f2a7a3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:37.352209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-376050a2-1d00-4b16-9db7-6df016f2a7a3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:37.352936 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-376050a2-1d00-4b16-9db7-6df016f2a7a3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:37.353930 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-376050a2-1d00-4b16-9db7-6df016f2a7a3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:37.354529 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-376050a2-1d00-4b16-9db7-6df016f2a7a3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:37.452800 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ac02716a-db20-44cc-8f8f-2ca8e019ecc3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:37.462029 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ac02716a-db20-44cc-8f8f-2ca8e019ecc3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 0.288080 Aug 03 10:44:37.476856 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 38/77] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:37 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:37.511245 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6bc9b4e6-1c00-442d-afbc-e1a23a28896d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:37.512071 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6bc9b4e6-1c00-442d-afbc-e1a23a28896d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:37.521706 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6bc9b4e6-1c00-442d-afbc-e1a23a28896d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:37.522452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6bc9b4e6-1c00-442d-afbc-e1a23a28896d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:37.523599 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6bc9b4e6-1c00-442d-afbc-e1a23a28896d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:37.524145 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6bc9b4e6-1c00-442d-afbc-e1a23a28896d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:37.564676 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-376050a2-1d00-4b16-9db7-6df016f2a7a3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:37.574029 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-376050a2-1d00-4b16-9db7-6df016f2a7a3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1322 microversion: 2.1 time: 0.238900 Aug 03 10:44:37.574726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 40/78] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:37 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:37.699594 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6bc9b4e6-1c00-442d-afbc-e1a23a28896d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:37.710568 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6bc9b4e6-1c00-442d-afbc-e1a23a28896d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 0.208143 Aug 03 10:44:37.711247 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 39/79] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:37 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:38.218964 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e4dbf34c-99dc-4dc3-99cf-2e183975df7c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:38.220025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e4dbf34c-99dc-4dc3-99cf-2e183975df7c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:38.247542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e4dbf34c-99dc-4dc3-99cf-2e183975df7c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:38.248876 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e4dbf34c-99dc-4dc3-99cf-2e183975df7c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:38.250876 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e4dbf34c-99dc-4dc3-99cf-2e183975df7c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:38.252067 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e4dbf34c-99dc-4dc3-99cf-2e183975df7c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:38.273212 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8df4b8e2-e983-494c-8ccd-ef585ec673b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:38.279529 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8df4b8e2-e983-494c-8ccd-ef585ec673b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:38.324804 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8df4b8e2-e983-494c-8ccd-ef585ec673b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:38.326973 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8df4b8e2-e983-494c-8ccd-ef585ec673b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:38.329036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8df4b8e2-e983-494c-8ccd-ef585ec673b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:38.330400 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8df4b8e2-e983-494c-8ccd-ef585ec673b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:38.439762 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e4dbf34c-99dc-4dc3-99cf-2e183975df7c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:38.450988 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e4dbf34c-99dc-4dc3-99cf-2e183975df7c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1367 microversion: 2.1 time: 0.238174 Aug 03 10:44:38.466001 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 41/80] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:38 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:38.494206 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-715b3403-0b72-409c-92c1-62a184da1a3b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:38.497010 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-715b3403-0b72-409c-92c1-62a184da1a3b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:38.519284 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-715b3403-0b72-409c-92c1-62a184da1a3b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:38.522477 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-715b3403-0b72-409c-92c1-62a184da1a3b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:38.524005 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-715b3403-0b72-409c-92c1-62a184da1a3b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:38.524740 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-715b3403-0b72-409c-92c1-62a184da1a3b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:38.801830 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8df4b8e2-e983-494c-8ccd-ef585ec673b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:38.815290 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8df4b8e2-e983-494c-8ccd-ef585ec673b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:38.819638 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8df4b8e2-e983-494c-8ccd-ef585ec673b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:38.823625 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8df4b8e2-e983-494c-8ccd-ef585ec673b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1406 microversion: 2.20 time: 0.562320 Aug 03 10:44:38.826684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 40/81] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:38 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1406 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:38.837759 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d4774e1f-c5ea-4b20-a4f8-d27954b41e53 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:38.838772 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d4774e1f-c5ea-4b20-a4f8-d27954b41e53 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:38.858279 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d4774e1f-c5ea-4b20-a4f8-d27954b41e53 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:38.858856 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d4774e1f-c5ea-4b20-a4f8-d27954b41e53 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:38.859874 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d4774e1f-c5ea-4b20-a4f8-d27954b41e53 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:38.860434 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d4774e1f-c5ea-4b20-a4f8-d27954b41e53 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:38.968479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-715b3403-0b72-409c-92c1-62a184da1a3b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:38.985645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-715b3403-0b72-409c-92c1-62a184da1a3b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 0.501807 Aug 03 10:44:38.987639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 42/82] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:38 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:39.014399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-037b0458-5745-44c0-b21e-052e1dcc8060 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:39.017559 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-037b0458-5745-44c0-b21e-052e1dcc8060 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:39.045067 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-037b0458-5745-44c0-b21e-052e1dcc8060 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:39.048353 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-037b0458-5745-44c0-b21e-052e1dcc8060 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:39.049237 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-037b0458-5745-44c0-b21e-052e1dcc8060 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:39.049730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-037b0458-5745-44c0-b21e-052e1dcc8060 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:39.488974 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d4774e1f-c5ea-4b20-a4f8-d27954b41e53 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:39.513955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d4774e1f-c5ea-4b20-a4f8-d27954b41e53 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1322 microversion: 2.1 time: 0.685598 Aug 03 10:44:39.525971 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 41/83] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:38 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1322 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:39.535092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7b15aea1-ccde-49dd-9a67-2acbad58d8fd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:39.536772 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7b15aea1-ccde-49dd-9a67-2acbad58d8fd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:39.555649 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7b15aea1-ccde-49dd-9a67-2acbad58d8fd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:39.562651 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7b15aea1-ccde-49dd-9a67-2acbad58d8fd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:39.568891 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7b15aea1-ccde-49dd-9a67-2acbad58d8fd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:39.569995 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7b15aea1-ccde-49dd-9a67-2acbad58d8fd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:39.587256 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-037b0458-5745-44c0-b21e-052e1dcc8060 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:39.613961 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-037b0458-5745-44c0-b21e-052e1dcc8060 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 0.622744 Aug 03 10:44:39.620572 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 43/84] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:38 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:39.872596 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-0663acf7-8d89-4fa4-bdd5-75ddd84ad898 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:39.873211 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-0663acf7-8d89-4fa4-bdd5-75ddd84ad898 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:39.886181 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0663acf7-8d89-4fa4-bdd5-75ddd84ad898 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:39.886832 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0663acf7-8d89-4fa4-bdd5-75ddd84ad898 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:39.887754 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0663acf7-8d89-4fa4-bdd5-75ddd84ad898 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:39.888318 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0663acf7-8d89-4fa4-bdd5-75ddd84ad898 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:40.287461 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7b15aea1-ccde-49dd-9a67-2acbad58d8fd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:40.296256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7b15aea1-ccde-49dd-9a67-2acbad58d8fd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1367 microversion: 2.1 time: 0.768299 Aug 03 10:44:40.296852 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 42/85] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:39 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1367 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:40.306924 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9131b06a-52fd-4723-88b9-22991cb41050 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:40.312875 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9131b06a-52fd-4723-88b9-22991cb41050 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:40.330108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9131b06a-52fd-4723-88b9-22991cb41050 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:40.330472 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9131b06a-52fd-4723-88b9-22991cb41050 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:40.331284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9131b06a-52fd-4723-88b9-22991cb41050 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:40.331756 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9131b06a-52fd-4723-88b9-22991cb41050 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:40.442493 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-0663acf7-8d89-4fa4-bdd5-75ddd84ad898 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:40.455418 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-0663acf7-8d89-4fa4-bdd5-75ddd84ad898 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:40.458550 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-0663acf7-8d89-4fa4-bdd5-75ddd84ad898 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:40.470567 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-0663acf7-8d89-4fa4-bdd5-75ddd84ad898 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1406 microversion: 2.20 time: 0.601746 Aug 03 10:44:40.471329 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 44/86] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:39 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1406 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:44:40.553294 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-f4d630f5-5e8d-4313-9fbe-d7f4808d4ec9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:40.553920 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-f4d630f5-5e8d-4313-9fbe-d7f4808d4ec9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:40.567622 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f4d630f5-5e8d-4313-9fbe-d7f4808d4ec9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:40.568177 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f4d630f5-5e8d-4313-9fbe-d7f4808d4ec9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:40.573281 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f4d630f5-5e8d-4313-9fbe-d7f4808d4ec9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:40.574057 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f4d630f5-5e8d-4313-9fbe-d7f4808d4ec9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:40.938472 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9131b06a-52fd-4723-88b9-22991cb41050 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:40.966590 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9131b06a-52fd-4723-88b9-22991cb41050 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 0.654852 Aug 03 10:44:40.972307 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 43/87] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:40 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:40.988923 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-60c3c173-8244-446c-8c29-254554a2a694 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:40.991473 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-60c3c173-8244-446c-8c29-254554a2a694 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:41.020865 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-60c3c173-8244-446c-8c29-254554a2a694 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:41.057226 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-60c3c173-8244-446c-8c29-254554a2a694 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:41.076262 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-60c3c173-8244-446c-8c29-254554a2a694 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:41.077488 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-60c3c173-8244-446c-8c29-254554a2a694 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:41.099580 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:41.258503 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f4d630f5-5e8d-4313-9fbe-d7f4808d4ec9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:41.311495 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-f4d630f5-5e8d-4313-9fbe-d7f4808d4ec9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1322 microversion: 2.1 time: 0.762175 Aug 03 10:44:41.329727 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 45/88] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:40 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1322 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:41.364459 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a2049828-c572-49f0-ac3d-8363ba73a0dd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:41.372566 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-a2049828-c572-49f0-ac3d-8363ba73a0dd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:41.394105 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a2049828-c572-49f0-ac3d-8363ba73a0dd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:41.396375 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a2049828-c572-49f0-ac3d-8363ba73a0dd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:41.398585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a2049828-c572-49f0-ac3d-8363ba73a0dd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:41.399488 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a2049828-c572-49f0-ac3d-8363ba73a0dd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:41.452657 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=100 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:41.640800 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-60c3c173-8244-446c-8c29-254554a2a694 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:41.654211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-60c3c173-8244-446c-8c29-254554a2a694 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 0.679837 Aug 03 10:44:41.655603 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 44/89] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:40 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:41.662420 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2362abdb-e948-4d41-af90-41aa22d6c123 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:41.663817 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2362abdb-e948-4d41-af90-41aa22d6c123 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:41.673324 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2362abdb-e948-4d41-af90-41aa22d6c123 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:41.673815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2362abdb-e948-4d41-af90-41aa22d6c123 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:41.674684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2362abdb-e948-4d41-af90-41aa22d6c123 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:41.675212 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2362abdb-e948-4d41-af90-41aa22d6c123 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:41.964100 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-a2049828-c572-49f0-ac3d-8363ba73a0dd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:41.978015 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-a2049828-c572-49f0-ac3d-8363ba73a0dd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1367 microversion: 2.1 time: 0.642081 Aug 03 10:44:41.979283 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 46/90] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:41 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1367 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:42.000573 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2362abdb-e948-4d41-af90-41aa22d6c123 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:42.019878 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d45a191c-21c8-4d95-af39-993dff912e0a tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:42.020028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2362abdb-e948-4d41-af90-41aa22d6c123 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:42.020835 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d45a191c-21c8-4d95-af39-993dff912e0a tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:42.023651 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2362abdb-e948-4d41-af90-41aa22d6c123 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:42.025967 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2362abdb-e948-4d41-af90-41aa22d6c123 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1406 microversion: 2.20 time: 0.368196 Aug 03 10:44:42.027669 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 45/91] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:41 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1406 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:42.045963 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d45a191c-21c8-4d95-af39-993dff912e0a tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:42.046663 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d45a191c-21c8-4d95-af39-993dff912e0a tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:42.048660 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d45a191c-21c8-4d95-af39-993dff912e0a tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:42.050117 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d45a191c-21c8-4d95-af39-993dff912e0a tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:42.271771 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d45a191c-21c8-4d95-af39-993dff912e0a tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:42.287684 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d45a191c-21c8-4d95-af39-993dff912e0a tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 0.282871 Aug 03 10:44:42.291287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 47/92] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:42 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:42.376075 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8dad2ebe-65f3-4b8a-8903-f3de5034d853 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:42.377225 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8dad2ebe-65f3-4b8a-8903-f3de5034d853 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:42.399267 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8dad2ebe-65f3-4b8a-8903-f3de5034d853 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:42.403076 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8dad2ebe-65f3-4b8a-8903-f3de5034d853 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:42.404338 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8dad2ebe-65f3-4b8a-8903-f3de5034d853 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:42.409221 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8dad2ebe-65f3-4b8a-8903-f3de5034d853 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:42.684687 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8dad2ebe-65f3-4b8a-8903-f3de5034d853 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:42.688736 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d63a3dc0-39c1-410a-b080-f694782907a2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:42.693123 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d63a3dc0-39c1-410a-b080-f694782907a2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:42.719078 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d63a3dc0-39c1-410a-b080-f694782907a2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:42.725189 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d63a3dc0-39c1-410a-b080-f694782907a2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:42.727577 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d63a3dc0-39c1-410a-b080-f694782907a2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:42.728570 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d63a3dc0-39c1-410a-b080-f694782907a2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:42.738760 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8dad2ebe-65f3-4b8a-8903-f3de5034d853 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1322 microversion: 2.1 time: 0.361960 Aug 03 10:44:42.742826 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 46/93] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:42 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:43.015339 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2543acbb-f1ca-4e66-9118-7d588c45a2ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:43.016063 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2543acbb-f1ca-4e66-9118-7d588c45a2ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:43.022718 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2543acbb-f1ca-4e66-9118-7d588c45a2ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:43.026128 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2543acbb-f1ca-4e66-9118-7d588c45a2ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:43.027066 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2543acbb-f1ca-4e66-9118-7d588c45a2ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:43.030051 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2543acbb-f1ca-4e66-9118-7d588c45a2ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:43.861234 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2543acbb-f1ca-4e66-9118-7d588c45a2ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:43.868262 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d63a3dc0-39c1-410a-b080-f694782907a2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:43.871881 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2543acbb-f1ca-4e66-9118-7d588c45a2ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1367 microversion: 2.1 time: 0.864639 Aug 03 10:44:43.885510 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 47/94] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:43 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1367 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:43.885889 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d63a3dc0-39c1-410a-b080-f694782907a2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 1.211464 Aug 03 10:44:43.886327 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9d5e83e1-10c6-4af3-a02d-a1187727d6a4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:43.889664 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9d5e83e1-10c6-4af3-a02d-a1187727d6a4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:43.894927 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 48/95] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:42 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:44:43.900069 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9d5e83e1-10c6-4af3-a02d-a1187727d6a4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:43.900891 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9d5e83e1-10c6-4af3-a02d-a1187727d6a4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:43.902536 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9d5e83e1-10c6-4af3-a02d-a1187727d6a4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:43.903558 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9d5e83e1-10c6-4af3-a02d-a1187727d6a4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:43.906122 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-65de4f33-8371-404f-83a0-fe90d85c30b4 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:43.907088 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-65de4f33-8371-404f-83a0-fe90d85c30b4 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:43.916105 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-65de4f33-8371-404f-83a0-fe90d85c30b4 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:43.917004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-65de4f33-8371-404f-83a0-fe90d85c30b4 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:43.918439 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-65de4f33-8371-404f-83a0-fe90d85c30b4 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:43.919609 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-65de4f33-8371-404f-83a0-fe90d85c30b4 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:44.272907 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-65de4f33-8371-404f-83a0-fe90d85c30b4 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:44.283995 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-65de4f33-8371-404f-83a0-fe90d85c30b4 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 0.385455 Aug 03 10:44:44.284596 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 49/96] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:43 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:44.387019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9d5e83e1-10c6-4af3-a02d-a1187727d6a4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:44.415957 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9d5e83e1-10c6-4af3-a02d-a1187727d6a4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:44.422159 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9d5e83e1-10c6-4af3-a02d-a1187727d6a4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:44.428175 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9d5e83e1-10c6-4af3-a02d-a1187727d6a4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1406 microversion: 2.20 time: 0.551045 Aug 03 10:44:44.431003 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:44.442327 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 48/97] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:43 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1406 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:44.451924 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-935b3503-4e3c-411c-a1c1-a79c630c3716 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:44.453055 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-935b3503-4e3c-411c-a1c1-a79c630c3716 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:44.461538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-935b3503-4e3c-411c-a1c1-a79c630c3716 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:44.462487 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-935b3503-4e3c-411c-a1c1-a79c630c3716 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:44.463644 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-935b3503-4e3c-411c-a1c1-a79c630c3716 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:44.464277 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-935b3503-4e3c-411c-a1c1-a79c630c3716 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:44.640491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-935b3503-4e3c-411c-a1c1-a79c630c3716 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:44.661653 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-935b3503-4e3c-411c-a1c1-a79c630c3716 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1322 microversion: 2.1 time: 0.216892 Aug 03 10:44:44.674677 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 49/98] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:44 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:44.775542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-3d5d2cbf-4fe0-45f1-b02b-cf7f04c49beb req-9199a307-fb13-43af-b75d-7be779dfb22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a399a7-91eb-41c8-b408-c5df154a36cc", "name": "network-vif-plugged", "status": "completed", "tag": "50f0f005-5fa8-46f1-aa89-9825cf666e40"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:44.786518 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-3d5d2cbf-4fe0-45f1-b02b-cf7f04c49beb req-9199a307-fb13-43af-b75d-7be779dfb22f service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:44.792386 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-3d5d2cbf-4fe0-45f1-b02b-cf7f04c49beb req-9199a307-fb13-43af-b75d-7be779dfb22f service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:44.813152 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-3d5d2cbf-4fe0-45f1-b02b-cf7f04c49beb req-9199a307-fb13-43af-b75d-7be779dfb22f service nova] Creating event network-vif-plugged:50f0f005-5fa8-46f1-aa89-9825cf666e40 for instance b6a399a7-91eb-41c8-b408-c5df154a36cc on hv-cinder-85083 Aug 03 10:44:44.820122 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-3d5d2cbf-4fe0-45f1-b02b-cf7f04c49beb req-9199a307-fb13-43af-b75d-7be779dfb22f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.531568 Aug 03 10:44:44.820968 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 50/99] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:44:44.898864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-27f7a905-7c0e-4192-8115-76f34607e4b7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:44.899479 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-27f7a905-7c0e-4192-8115-76f34607e4b7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:44.912270 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-22b34269-f4a4-4e2f-9b58-510d4cb31c10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:44.913746 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-22b34269-f4a4-4e2f-9b58-510d4cb31c10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:44.915289 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-27f7a905-7c0e-4192-8115-76f34607e4b7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:44.918770 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-27f7a905-7c0e-4192-8115-76f34607e4b7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:44.919998 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-27f7a905-7c0e-4192-8115-76f34607e4b7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:44.923472 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-27f7a905-7c0e-4192-8115-76f34607e4b7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:44.931935 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-22b34269-f4a4-4e2f-9b58-510d4cb31c10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:44.932396 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-22b34269-f4a4-4e2f-9b58-510d4cb31c10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:44.938905 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-22b34269-f4a4-4e2f-9b58-510d4cb31c10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:44.940485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-22b34269-f4a4-4e2f-9b58-510d4cb31c10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:45.467234 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-22b34269-f4a4-4e2f-9b58-510d4cb31c10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:45.481918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-22b34269-f4a4-4e2f-9b58-510d4cb31c10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 0.577055 Aug 03 10:44:45.487458 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 51/100] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:44 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:45.515493 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-7d6cd44e-5e30-4c88-aa62-a8548d57f5e2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:45.516358 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-7d6cd44e-5e30-4c88-aa62-a8548d57f5e2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:45.537329 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7d6cd44e-5e30-4c88-aa62-a8548d57f5e2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:45.538730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7d6cd44e-5e30-4c88-aa62-a8548d57f5e2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:45.542432 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7d6cd44e-5e30-4c88-aa62-a8548d57f5e2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:45.547582 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7d6cd44e-5e30-4c88-aa62-a8548d57f5e2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:45.563953 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-27f7a905-7c0e-4192-8115-76f34607e4b7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:45.588696 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-27f7a905-7c0e-4192-8115-76f34607e4b7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1367 microversion: 2.1 time: 0.693737 Aug 03 10:44:45.591046 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 50/101] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:44 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1367 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:45.600536 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b7dc6c9a-ae8a-4c15-930c-e2b9b33c1d7c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:45.602292 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b7dc6c9a-ae8a-4c15-930c-e2b9b33c1d7c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:45.636072 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b7dc6c9a-ae8a-4c15-930c-e2b9b33c1d7c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:45.636807 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b7dc6c9a-ae8a-4c15-930c-e2b9b33c1d7c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:45.638540 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b7dc6c9a-ae8a-4c15-930c-e2b9b33c1d7c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:45.641261 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b7dc6c9a-ae8a-4c15-930c-e2b9b33c1d7c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:46.371968 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7d6cd44e-5e30-4c88-aa62-a8548d57f5e2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:46.376669 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b7dc6c9a-ae8a-4c15-930c-e2b9b33c1d7c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:46.388179 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b7dc6c9a-ae8a-4c15-930c-e2b9b33c1d7c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:46.390328 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b7dc6c9a-ae8a-4c15-930c-e2b9b33c1d7c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:46.392453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b7dc6c9a-ae8a-4c15-930c-e2b9b33c1d7c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1406 microversion: 2.20 time: 0.800127 Aug 03 10:44:46.397338 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-7d6cd44e-5e30-4c88-aa62-a8548d57f5e2 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 0.906664 Aug 03 10:44:46.411319 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 51/102] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:45 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1406 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:46.418324 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 52/103] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:45 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:46.422130 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e2b876e9-45bb-4645-a3b8-30ba71cbe2f7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:46.423276 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e2b876e9-45bb-4645-a3b8-30ba71cbe2f7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:46.432379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e2b876e9-45bb-4645-a3b8-30ba71cbe2f7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:46.433127 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e2b876e9-45bb-4645-a3b8-30ba71cbe2f7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:46.434274 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e2b876e9-45bb-4645-a3b8-30ba71cbe2f7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:46.434709 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e2b876e9-45bb-4645-a3b8-30ba71cbe2f7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:46.538707 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-84c1227a-bfa3-4ffa-9844-eb34e53ce309 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:46.539656 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-84c1227a-bfa3-4ffa-9844-eb34e53ce309 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:46.563413 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-84c1227a-bfa3-4ffa-9844-eb34e53ce309 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:46.565293 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-84c1227a-bfa3-4ffa-9844-eb34e53ce309 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:46.572240 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-84c1227a-bfa3-4ffa-9844-eb34e53ce309 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:46.573183 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-84c1227a-bfa3-4ffa-9844-eb34e53ce309 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:46.667123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e2b876e9-45bb-4645-a3b8-30ba71cbe2f7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:46.677116 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e2b876e9-45bb-4645-a3b8-30ba71cbe2f7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1322 microversion: 2.1 time: 0.264307 Aug 03 10:44:46.677758 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 52/104] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:46 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:46.708079 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3fe880fe-bc16-476f-977d-54afb92787e4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:46.708719 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3fe880fe-bc16-476f-977d-54afb92787e4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:46.723158 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3fe880fe-bc16-476f-977d-54afb92787e4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:46.723595 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3fe880fe-bc16-476f-977d-54afb92787e4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:46.724374 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3fe880fe-bc16-476f-977d-54afb92787e4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:46.724810 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3fe880fe-bc16-476f-977d-54afb92787e4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:47.093077 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-84c1227a-bfa3-4ffa-9844-eb34e53ce309 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:47.107015 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-84c1227a-bfa3-4ffa-9844-eb34e53ce309 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 0.574726 Aug 03 10:44:47.107890 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 53/105] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:46 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:47.112568 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-9054080e-aea9-45b8-b22d-ca8009a11ab9 req-6436c40d-870a-4970-b681-072a2285c2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8ef6f9-29fe-4627-9bed-212ed8006761", "name": "network-vif-plugged", "status": "completed", "tag": "e942a2d5-2eea-4a00-b545-1474d8da6cce"}, {"server_uuid": "da275cd5-e209-45c5-a46e-3082d668a6b5", "name": "network-vif-plugged", "status": "completed", "tag": "7a2adba4-8abd-4f8c-a020-c7fae10e3050"}, {"server_uuid": "fbb281c5-ccf1-4de2-99fb-5201efd51b09", "name": "network-vif-plugged", "status": "completed", "tag": "908667e2-7286-4600-aa74-6161652b25ca"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:47.137074 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-9054080e-aea9-45b8-b22d-ca8009a11ab9 req-6436c40d-870a-4970-b681-072a2285c2e5 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:47.137748 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-9054080e-aea9-45b8-b22d-ca8009a11ab9 req-6436c40d-870a-4970-b681-072a2285c2e5 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:47.145577 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3fe880fe-bc16-476f-977d-54afb92787e4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:47.156373 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3fe880fe-bc16-476f-977d-54afb92787e4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1367 microversion: 2.1 time: 0.476272 Aug 03 10:44:47.158859 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 53/106] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:46 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1367 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:47.172033 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-9054080e-aea9-45b8-b22d-ca8009a11ab9 req-6436c40d-870a-4970-b681-072a2285c2e5 service nova] Creating event network-vif-plugged:e942a2d5-2eea-4a00-b545-1474d8da6cce for instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 on hv-cinder-85083 Aug 03 10:44:47.172700 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-9054080e-aea9-45b8-b22d-ca8009a11ab9 req-6436c40d-870a-4970-b681-072a2285c2e5 service nova] Creating event network-vif-plugged:7a2adba4-8abd-4f8c-a020-c7fae10e3050 for instance da275cd5-e209-45c5-a46e-3082d668a6b5 on hv-cinder-85083 Aug 03 10:44:47.173209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-9054080e-aea9-45b8-b22d-ca8009a11ab9 req-6436c40d-870a-4970-b681-072a2285c2e5 service nova] Creating event network-vif-plugged:908667e2-7286-4600-aa74-6161652b25ca for instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 on hv-cinder-85083 Aug 03 10:44:47.183011 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-9054080e-aea9-45b8-b22d-ca8009a11ab9 req-6436c40d-870a-4970-b681-072a2285c2e5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.073687 Aug 03 10:44:47.183637 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 54/107] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:44:47.418528 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a7b99308-e0e4-409a-baa0-6ba21bd349ab tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:47.419143 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a7b99308-e0e4-409a-baa0-6ba21bd349ab tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:47.432167 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a7b99308-e0e4-409a-baa0-6ba21bd349ab tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:47.434102 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a7b99308-e0e4-409a-baa0-6ba21bd349ab tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:47.436390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a7b99308-e0e4-409a-baa0-6ba21bd349ab tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:47.439266 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a7b99308-e0e4-409a-baa0-6ba21bd349ab tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:47.457641 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-caf7b3d6-1397-4a9b-be38-cf1b163a56f1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:47.463701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-caf7b3d6-1397-4a9b-be38-cf1b163a56f1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:47.494886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-caf7b3d6-1397-4a9b-be38-cf1b163a56f1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:47.496258 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-caf7b3d6-1397-4a9b-be38-cf1b163a56f1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:47.500690 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-caf7b3d6-1397-4a9b-be38-cf1b163a56f1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:47.501429 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-caf7b3d6-1397-4a9b-be38-cf1b163a56f1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:47.911152 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a7b99308-e0e4-409a-baa0-6ba21bd349ab tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:47.928471 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a7b99308-e0e4-409a-baa0-6ba21bd349ab tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:47.933179 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a7b99308-e0e4-409a-baa0-6ba21bd349ab tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:47.934500 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a7b99308-e0e4-409a-baa0-6ba21bd349ab tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1406 microversion: 2.20 time: 0.521230 Aug 03 10:44:47.937437 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 54/108] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:47 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1406 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:47.942888 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1d0e7d87-70a0-4495-ac4c-f993a8de6bf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:47.943714 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1d0e7d87-70a0-4495-ac4c-f993a8de6bf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:47.951119 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1d0e7d87-70a0-4495-ac4c-f993a8de6bf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:47.952059 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1d0e7d87-70a0-4495-ac4c-f993a8de6bf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:47.955605 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1d0e7d87-70a0-4495-ac4c-f993a8de6bf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:47.956246 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1d0e7d87-70a0-4495-ac4c-f993a8de6bf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:48.085128 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-caf7b3d6-1397-4a9b-be38-cf1b163a56f1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:48.102405 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-caf7b3d6-1397-4a9b-be38-cf1b163a56f1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 0.662177 Aug 03 10:44:48.103834 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 55/109] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:47 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:44:48.157670 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-22aa7a75-ac27-48fc-8e8c-5fd0a01a1918 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:48.165776 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1d0e7d87-70a0-4495-ac4c-f993a8de6bf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:48.170301 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-22aa7a75-ac27-48fc-8e8c-5fd0a01a1918 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:48.182311 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1d0e7d87-70a0-4495-ac4c-f993a8de6bf2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1322 microversion: 2.1 time: 0.243026 Aug 03 10:44:48.197847 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-22aa7a75-ac27-48fc-8e8c-5fd0a01a1918 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:48.198786 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-22aa7a75-ac27-48fc-8e8c-5fd0a01a1918 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:48.199316 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 55/110] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:47 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:48.199885 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-22aa7a75-ac27-48fc-8e8c-5fd0a01a1918 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:48.200442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-22aa7a75-ac27-48fc-8e8c-5fd0a01a1918 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:48.220226 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e44a776c-2d6b-4353-956c-66dd18b2051a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:48.226076 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e44a776c-2d6b-4353-956c-66dd18b2051a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:48.254983 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e44a776c-2d6b-4353-956c-66dd18b2051a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:48.260719 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e44a776c-2d6b-4353-956c-66dd18b2051a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:48.265215 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e44a776c-2d6b-4353-956c-66dd18b2051a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:48.266902 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e44a776c-2d6b-4353-956c-66dd18b2051a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:48.598504 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-22aa7a75-ac27-48fc-8e8c-5fd0a01a1918 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:48.627399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-22aa7a75-ac27-48fc-8e8c-5fd0a01a1918 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 0.473522 Aug 03 10:44:48.643220 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 56/111] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:48 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:48.713903 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e44a776c-2d6b-4353-956c-66dd18b2051a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:48.728951 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e44a776c-2d6b-4353-956c-66dd18b2051a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1556 microversion: 2.1 time: 0.527398 Aug 03 10:44:48.729571 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 56/112] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:48 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1556 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:48.751423 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-90219796-2b9c-4dbe-b069-51ab5fb1fddd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:48.752183 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-90219796-2b9c-4dbe-b069-51ab5fb1fddd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:48.771370 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-90219796-2b9c-4dbe-b069-51ab5fb1fddd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:48.771836 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-90219796-2b9c-4dbe-b069-51ab5fb1fddd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:48.772645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-90219796-2b9c-4dbe-b069-51ab5fb1fddd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:48.773109 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-90219796-2b9c-4dbe-b069-51ab5fb1fddd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:48.916471 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-90219796-2b9c-4dbe-b069-51ab5fb1fddd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169386 Aug 03 10:44:48.917240 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 57/113] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 3 10:44:48 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:44:48.966426 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-631f8262-bf68-46f3-989d-4efd508c9374 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:48.968824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-631f8262-bf68-46f3-989d-4efd508c9374 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:48.995593 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-631f8262-bf68-46f3-989d-4efd508c9374 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:48.996515 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-631f8262-bf68-46f3-989d-4efd508c9374 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:48.998257 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-631f8262-bf68-46f3-989d-4efd508c9374 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:48.998645 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-631f8262-bf68-46f3-989d-4efd508c9374 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:49.124605 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-553162cc-7955-4f6d-aa01-794bcbbdadc0 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:49.125539 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-553162cc-7955-4f6d-aa01-794bcbbdadc0 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:49.139566 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-553162cc-7955-4f6d-aa01-794bcbbdadc0 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:49.140033 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-553162cc-7955-4f6d-aa01-794bcbbdadc0 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:49.143411 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-553162cc-7955-4f6d-aa01-794bcbbdadc0 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:49.143911 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-553162cc-7955-4f6d-aa01-794bcbbdadc0 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:49.313191 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-631f8262-bf68-46f3-989d-4efd508c9374 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:49.346074 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-631f8262-bf68-46f3-989d-4efd508c9374 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:49.352470 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-631f8262-bf68-46f3-989d-4efd508c9374 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:49.356357 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-631f8262-bf68-46f3-989d-4efd508c9374 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1406 microversion: 2.20 time: 0.400699 Aug 03 10:44:49.371544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 57/114] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:48 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1406 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:49.388311 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-957f3857-61a0-4a0c-ba05-ca1a8d6df1c3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:49.389251 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-957f3857-61a0-4a0c-ba05-ca1a8d6df1c3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:49.408159 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-957f3857-61a0-4a0c-ba05-ca1a8d6df1c3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:49.408980 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-957f3857-61a0-4a0c-ba05-ca1a8d6df1c3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:49.410261 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-957f3857-61a0-4a0c-ba05-ca1a8d6df1c3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:49.410884 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-957f3857-61a0-4a0c-ba05-ca1a8d6df1c3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:49.447454 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-553162cc-7955-4f6d-aa01-794bcbbdadc0 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:49.463840 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-553162cc-7955-4f6d-aa01-794bcbbdadc0 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 0.343403 Aug 03 10:44:49.464431 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 58/115] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:49 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:49.469278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-a20c379a-5229-4e61-b24e-05fa3e3372b8 req-af81eec5-8e34-4f83-adab-fa485f5ddd15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffac1966-f7c4-4029-89d1-2d7010eba5da", "name": "network-vif-plugged", "status": "completed", "tag": "be45d1ac-e48b-4761-bcee-1161cea179a4"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:49.521673 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-a20c379a-5229-4e61-b24e-05fa3e3372b8 req-af81eec5-8e34-4f83-adab-fa485f5ddd15 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:49.522799 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-a20c379a-5229-4e61-b24e-05fa3e3372b8 req-af81eec5-8e34-4f83-adab-fa485f5ddd15 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:49.597923 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-a20c379a-5229-4e61-b24e-05fa3e3372b8 req-af81eec5-8e34-4f83-adab-fa485f5ddd15 service nova] Creating event network-vif-plugged:be45d1ac-e48b-4761-bcee-1161cea179a4 for instance ffac1966-f7c4-4029-89d1-2d7010eba5da on hv-cinder-85083 Aug 03 10:44:49.609104 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-a20c379a-5229-4e61-b24e-05fa3e3372b8 req-af81eec5-8e34-4f83-adab-fa485f5ddd15 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143116 Aug 03 10:44:49.612641 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 59/116] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:44:49.673491 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-54283efe-8477-4286-90a0-874a8ef3f742 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:49.674950 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-54283efe-8477-4286-90a0-874a8ef3f742 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:49.685999 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-54283efe-8477-4286-90a0-874a8ef3f742 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:49.687206 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-54283efe-8477-4286-90a0-874a8ef3f742 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:49.688691 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-54283efe-8477-4286-90a0-874a8ef3f742 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:49.689635 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-54283efe-8477-4286-90a0-874a8ef3f742 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:49.774685 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-957f3857-61a0-4a0c-ba05-ca1a8d6df1c3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:49.788070 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-957f3857-61a0-4a0c-ba05-ca1a8d6df1c3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1322 microversion: 2.1 time: 0.410840 Aug 03 10:44:49.790760 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 58/117] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:49 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:49.938910 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-54283efe-8477-4286-90a0-874a8ef3f742 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:49.949071 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-54283efe-8477-4286-90a0-874a8ef3f742 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 0.283529 Aug 03 10:44:49.950294 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 60/118] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:49 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:50.389645 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8a7dabf3-4671-400f-bf11-63c5152fe59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:50.391112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8a7dabf3-4671-400f-bf11-63c5152fe59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:50.415509 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8a7dabf3-4671-400f-bf11-63c5152fe59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:50.417061 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8a7dabf3-4671-400f-bf11-63c5152fe59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:50.418997 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8a7dabf3-4671-400f-bf11-63c5152fe59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:50.420073 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8a7dabf3-4671-400f-bf11-63c5152fe59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:50.501587 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2cffa121-e091-49b8-951e-b440c8784ea3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:50.502739 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2cffa121-e091-49b8-951e-b440c8784ea3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:50.512995 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2cffa121-e091-49b8-951e-b440c8784ea3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:50.513929 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2cffa121-e091-49b8-951e-b440c8784ea3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:50.515218 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2cffa121-e091-49b8-951e-b440c8784ea3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:50.515921 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2cffa121-e091-49b8-951e-b440c8784ea3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:50.881099 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8a7dabf3-4671-400f-bf11-63c5152fe59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:50.908382 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8a7dabf3-4671-400f-bf11-63c5152fe59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:50.920787 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8a7dabf3-4671-400f-bf11-63c5152fe59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:50.922480 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8a7dabf3-4671-400f-bf11-63c5152fe59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1406 microversion: 2.20 time: 0.540121 Aug 03 10:44:50.932422 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 59/119] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:50 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1406 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:50.946056 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f3fa2d76-41c9-4d11-a561-ebc7bf21c278 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:50.947875 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f3fa2d76-41c9-4d11-a561-ebc7bf21c278 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:50.956309 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=86 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:50.964054 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f3fa2d76-41c9-4d11-a561-ebc7bf21c278 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:50.967436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f3fa2d76-41c9-4d11-a561-ebc7bf21c278 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:50.968833 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f3fa2d76-41c9-4d11-a561-ebc7bf21c278 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:50.969258 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f3fa2d76-41c9-4d11-a561-ebc7bf21c278 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:50.991149 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2cffa121-e091-49b8-951e-b440c8784ea3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:51.037255 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2cffa121-e091-49b8-951e-b440c8784ea3 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 0.536556 Aug 03 10:44:51.040675 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 61/120] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:50 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:44:51.066857 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-0fb79623-f1ea-4521-a913-aa765aa7022a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:51.067839 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-0fb79623-f1ea-4521-a913-aa765aa7022a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:51.093660 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0fb79623-f1ea-4521-a913-aa765aa7022a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:51.094904 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0fb79623-f1ea-4521-a913-aa765aa7022a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:51.097083 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0fb79623-f1ea-4521-a913-aa765aa7022a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:51.098321 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0fb79623-f1ea-4521-a913-aa765aa7022a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:51.294928 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f3fa2d76-41c9-4d11-a561-ebc7bf21c278 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:51.299862 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:51.311218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f3fa2d76-41c9-4d11-a561-ebc7bf21c278 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1322 microversion: 2.1 time: 0.376953 Aug 03 10:44:51.314146 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 60/121] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:50 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:51.387824 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-0fb79623-f1ea-4521-a913-aa765aa7022a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:51.406821 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-0fb79623-f1ea-4521-a913-aa765aa7022a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 0.354601 Aug 03 10:44:51.407496 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 62/122] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:51 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:51.473281 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-b338bba5-b8a8-4ac4-8e33-a62246321b90 req-85b9a264-f272-4e7a-ac06-a633b422e963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a399a7-91eb-41c8-b408-c5df154a36cc", "tag": "50f0f005-5fa8-46f1-aa89-9825cf666e40"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:51.493702 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-b338bba5-b8a8-4ac4-8e33-a62246321b90 req-85b9a264-f272-4e7a-ac06-a633b422e963 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:51.494805 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-b338bba5-b8a8-4ac4-8e33-a62246321b90 req-85b9a264-f272-4e7a-ac06-a633b422e963 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:51.518048 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-b338bba5-b8a8-4ac4-8e33-a62246321b90 req-85b9a264-f272-4e7a-ac06-a633b422e963 service nova] Creating event network-changed:50f0f005-5fa8-46f1-aa89-9825cf666e40 for instance b6a399a7-91eb-41c8-b408-c5df154a36cc on hv-cinder-85083 Aug 03 10:44:51.518694 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-b338bba5-b8a8-4ac4-8e33-a62246321b90 req-85b9a264-f272-4e7a-ac06-a633b422e963 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124388) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 10:44:51.519874 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e86badd8-15bc-4772-9643-7a5c9c87d4a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:51.520321 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e86badd8-15bc-4772-9643-7a5c9c87d4a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:51.521125 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e86badd8-15bc-4772-9643-7a5c9c87d4a7 None None] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:51.521585 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e86badd8-15bc-4772-9643-7a5c9c87d4a7 None None] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:51.531405 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.compute.rpcapi [None req-e86badd8-15bc-4772-9643-7a5c9c87d4a7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 10:44:51.532320 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e86badd8-15bc-4772-9643-7a5c9c87d4a7 None None] Releasing lock "compute-rpcapi-router" {{(pid=124388) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 10:44:51.553240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e86badd8-15bc-4772-9643-7a5c9c87d4a7 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085135 Aug 03 10:44:51.554285 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 61/123] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:44:51.628072 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-f18f8e29-def5-48b3-bca6-49f1b6980b16 req-786d5fd7-663d-48bf-80c4-512575e521f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5895a291-434d-4b7c-85cd-0264cf37f5f3", "name": "network-vif-plugged", "status": "completed", "tag": "971e4968-4040-4784-a0ed-4c689d9711ff"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:51.639049 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-f18f8e29-def5-48b3-bca6-49f1b6980b16 req-786d5fd7-663d-48bf-80c4-512575e521f3 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:51.639485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-f18f8e29-def5-48b3-bca6-49f1b6980b16 req-786d5fd7-663d-48bf-80c4-512575e521f3 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:51.651414 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-f18f8e29-def5-48b3-bca6-49f1b6980b16 req-786d5fd7-663d-48bf-80c4-512575e521f3 service nova] Creating event network-vif-plugged:971e4968-4040-4784-a0ed-4c689d9711ff for instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 on hv-cinder-85083 Aug 03 10:44:51.656450 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-f18f8e29-def5-48b3-bca6-49f1b6980b16 req-786d5fd7-663d-48bf-80c4-512575e521f3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032258 Aug 03 10:44:51.657255 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 63/124] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:44:51.966578 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6d0ba53a-c34b-44f5-8cb4-3da5a3f05108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:51.968292 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6d0ba53a-c34b-44f5-8cb4-3da5a3f05108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:51.980828 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d0ba53a-c34b-44f5-8cb4-3da5a3f05108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:51.980828 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d0ba53a-c34b-44f5-8cb4-3da5a3f05108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:51.980828 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d0ba53a-c34b-44f5-8cb4-3da5a3f05108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:51.980828 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d0ba53a-c34b-44f5-8cb4-3da5a3f05108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:52.072073 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-afe71c7e-4f59-4fb3-bc0d-ee451d15d1d1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:52.072918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-afe71c7e-4f59-4fb3-bc0d-ee451d15d1d1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:52.084575 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-afe71c7e-4f59-4fb3-bc0d-ee451d15d1d1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:52.086246 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-afe71c7e-4f59-4fb3-bc0d-ee451d15d1d1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:52.087325 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-afe71c7e-4f59-4fb3-bc0d-ee451d15d1d1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:52.087949 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-afe71c7e-4f59-4fb3-bc0d-ee451d15d1d1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:52.221765 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6d0ba53a-c34b-44f5-8cb4-3da5a3f05108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:52.236654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6d0ba53a-c34b-44f5-8cb4-3da5a3f05108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:52.239147 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6d0ba53a-c34b-44f5-8cb4-3da5a3f05108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:52.240258 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6d0ba53a-c34b-44f5-8cb4-3da5a3f05108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1406 microversion: 2.20 time: 0.279105 Aug 03 10:44:52.240835 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 62/125] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:51 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:44:52.305603 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-afe71c7e-4f59-4fb3-bc0d-ee451d15d1d1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:52.317723 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-afe71c7e-4f59-4fb3-bc0d-ee451d15d1d1 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1314 microversion: 2.1 time: 0.249694 Aug 03 10:44:52.331027 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 64/126] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:52 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:44:52.341427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-da6fef4c-0d0c-46ce-ba71-d6f6faf80c34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:52.342135 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-da6fef4c-0d0c-46ce-ba71-d6f6faf80c34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:52.349171 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-da6fef4c-0d0c-46ce-ba71-d6f6faf80c34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:52.349656 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-da6fef4c-0d0c-46ce-ba71-d6f6faf80c34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:52.350695 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-da6fef4c-0d0c-46ce-ba71-d6f6faf80c34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:52.351184 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-da6fef4c-0d0c-46ce-ba71-d6f6faf80c34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:52.428936 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-963dc5ac-01c5-4cc5-83cb-5dc01f5fe6c1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:52.429633 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-963dc5ac-01c5-4cc5-83cb-5dc01f5fe6c1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:52.436918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-963dc5ac-01c5-4cc5-83cb-5dc01f5fe6c1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:52.446393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-963dc5ac-01c5-4cc5-83cb-5dc01f5fe6c1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:52.447260 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-963dc5ac-01c5-4cc5-83cb-5dc01f5fe6c1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:52.447697 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-963dc5ac-01c5-4cc5-83cb-5dc01f5fe6c1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:52.534790 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-da6fef4c-0d0c-46ce-ba71-d6f6faf80c34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:52.548316 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-da6fef4c-0d0c-46ce-ba71-d6f6faf80c34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1322 microversion: 2.1 time: 0.211588 Aug 03 10:44:52.549353 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 63/127] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:52 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:52.697263 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-963dc5ac-01c5-4cc5-83cb-5dc01f5fe6c1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:52.706276 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-963dc5ac-01c5-4cc5-83cb-5dc01f5fe6c1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1363 microversion: 2.1 time: 0.282007 Aug 03 10:44:52.709858 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 65/128] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:52 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:44:53.267582 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-59314bf7-4a21-4e69-9dad-939829663e52 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:53.268234 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-59314bf7-4a21-4e69-9dad-939829663e52 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:53.292765 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-59314bf7-4a21-4e69-9dad-939829663e52 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:53.293224 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-59314bf7-4a21-4e69-9dad-939829663e52 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:53.294046 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-59314bf7-4a21-4e69-9dad-939829663e52 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:53.294494 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-59314bf7-4a21-4e69-9dad-939829663e52 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:53.345137 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-f3f006f8-4abd-47d1-9cac-e73cc0b48472 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:53.345924 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-f3f006f8-4abd-47d1-9cac-e73cc0b48472 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:53.348995 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=89 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:53.364676 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f3f006f8-4abd-47d1-9cac-e73cc0b48472 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:53.366017 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f3f006f8-4abd-47d1-9cac-e73cc0b48472 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:53.366903 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f3f006f8-4abd-47d1-9cac-e73cc0b48472 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:53.367929 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f3f006f8-4abd-47d1-9cac-e73cc0b48472 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:53.373764 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=100 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:44:53.558247 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-59314bf7-4a21-4e69-9dad-939829663e52 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:53.569373 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-59314bf7-4a21-4e69-9dad-939829663e52 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:53.571498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-59314bf7-4a21-4e69-9dad-939829663e52 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:53.573958 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-59314bf7-4a21-4e69-9dad-939829663e52 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1406 microversion: 2.20 time: 0.310703 Aug 03 10:44:53.575012 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 64/129] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:53 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1406 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:53.599012 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c10f9c9f-d609-4699-b165-bc4237ffe00b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:53.600049 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c10f9c9f-d609-4699-b165-bc4237ffe00b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:53.623932 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c10f9c9f-d609-4699-b165-bc4237ffe00b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:53.624470 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c10f9c9f-d609-4699-b165-bc4237ffe00b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:53.625921 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c10f9c9f-d609-4699-b165-bc4237ffe00b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:53.626503 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c10f9c9f-d609-4699-b165-bc4237ffe00b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:53.713994 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f3f006f8-4abd-47d1-9cac-e73cc0b48472 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:53.727061 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-f3f006f8-4abd-47d1-9cac-e73cc0b48472 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1500 microversion: 2.1 time: 0.387076 Aug 03 10:44:53.729299 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 66/130] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:53 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1500 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:44:53.757079 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-13dfb72b-98b9-4c30-88bd-1d63b79d46c2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:53.764838 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-13dfb72b-98b9-4c30-88bd-1d63b79d46c2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:53.781688 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-13dfb72b-98b9-4c30-88bd-1d63b79d46c2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:53.787328 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-13dfb72b-98b9-4c30-88bd-1d63b79d46c2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:53.797161 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-13dfb72b-98b9-4c30-88bd-1d63b79d46c2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:53.797161 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-13dfb72b-98b9-4c30-88bd-1d63b79d46c2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:53.908600 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c10f9c9f-d609-4699-b165-bc4237ffe00b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:53.925206 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c10f9c9f-d609-4699-b165-bc4237ffe00b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1322 microversion: 2.1 time: 0.337316 Aug 03 10:44:53.926517 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 65/131] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:53 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:54.143493 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-13dfb72b-98b9-4c30-88bd-1d63b79d46c2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:54.156309 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-13dfb72b-98b9-4c30-88bd-1d63b79d46c2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1549 microversion: 2.1 time: 0.409363 Aug 03 10:44:54.169935 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 67/132] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:53 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1549 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:54.181041 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5244941a-2e3d-4115-8080-eda0060c42d2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:54.181751 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5244941a-2e3d-4115-8080-eda0060c42d2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:54.189118 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5244941a-2e3d-4115-8080-eda0060c42d2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:54.189658 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5244941a-2e3d-4115-8080-eda0060c42d2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:54.190629 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5244941a-2e3d-4115-8080-eda0060c42d2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:54.191619 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5244941a-2e3d-4115-8080-eda0060c42d2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:54.339465 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5244941a-2e3d-4115-8080-eda0060c42d2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163102 Aug 03 10:44:54.340686 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 66/133] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 3 10:44:54 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:44:54.611344 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ed090ef7-98e9-4327-ae5c-0ef44eee3c5e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:54.613744 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-ed090ef7-98e9-4327-ae5c-0ef44eee3c5e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:54.625509 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ed090ef7-98e9-4327-ae5c-0ef44eee3c5e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:54.626600 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ed090ef7-98e9-4327-ae5c-0ef44eee3c5e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:54.628152 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ed090ef7-98e9-4327-ae5c-0ef44eee3c5e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:54.629120 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ed090ef7-98e9-4327-ae5c-0ef44eee3c5e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:54.953336 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-434affca-8e35-4d30-b8b9-a597dfed3462 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:54.954151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-434affca-8e35-4d30-b8b9-a597dfed3462 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:54.967155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-434affca-8e35-4d30-b8b9-a597dfed3462 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:54.968326 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-434affca-8e35-4d30-b8b9-a597dfed3462 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:54.970450 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-434affca-8e35-4d30-b8b9-a597dfed3462 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:54.971389 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-434affca-8e35-4d30-b8b9-a597dfed3462 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:54.982137 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-ed090ef7-98e9-4327-ae5c-0ef44eee3c5e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:55.044800 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-ed090ef7-98e9-4327-ae5c-0ef44eee3c5e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:55.056577 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-ed090ef7-98e9-4327-ae5c-0ef44eee3c5e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:55.058881 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ed090ef7-98e9-4327-ae5c-0ef44eee3c5e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1406 microversion: 2.20 time: 0.459681 Aug 03 10:44:55.059931 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 68/134] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:54 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1406 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:55.230538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-434affca-8e35-4d30-b8b9-a597dfed3462 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:55.253429 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-434affca-8e35-4d30-b8b9-a597dfed3462 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1322 microversion: 2.1 time: 0.303988 Aug 03 10:44:55.275748 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 67/135] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:54 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:55.524302 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-59278fb7-d8cc-41ee-b0b9-667ebbd3f911 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "917c2364-5cee-4a64-aa44-00db943d9eb5"}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:55.528037 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-59278fb7-d8cc-41ee-b0b9-667ebbd3f911 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:55.539493 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-59278fb7-d8cc-41ee-b0b9-667ebbd3f911 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:55.540447 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-59278fb7-d8cc-41ee-b0b9-667ebbd3f911 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:55.542499 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-59278fb7-d8cc-41ee-b0b9-667ebbd3f911 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:55.543397 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-59278fb7-d8cc-41ee-b0b9-667ebbd3f911 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:56.086529 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-dd6e1932-f4f7-4182-8f3c-20957b12d280 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:56.089262 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-dd6e1932-f4f7-4182-8f3c-20957b12d280 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:56.103459 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dd6e1932-f4f7-4182-8f3c-20957b12d280 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:56.104211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dd6e1932-f4f7-4182-8f3c-20957b12d280 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:56.106418 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dd6e1932-f4f7-4182-8f3c-20957b12d280 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:56.107198 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dd6e1932-f4f7-4182-8f3c-20957b12d280 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:56.464502 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-dd6e1932-f4f7-4182-8f3c-20957b12d280 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:56.507661 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-dd6e1932-f4f7-4182-8f3c-20957b12d280 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:56.517888 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-dd6e1932-f4f7-4182-8f3c-20957b12d280 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:56.522494 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-dd6e1932-f4f7-4182-8f3c-20957b12d280 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1406 microversion: 2.20 time: 0.443501 Aug 03 10:44:56.525543 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 68/136] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:56 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1406 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:44:56.557974 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9b71314f-8a1f-465e-830b-045d8a23a5d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:56.558929 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9b71314f-8a1f-465e-830b-045d8a23a5d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:56.581005 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b71314f-8a1f-465e-830b-045d8a23a5d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:56.584902 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b71314f-8a1f-465e-830b-045d8a23a5d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:56.588920 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b71314f-8a1f-465e-830b-045d8a23a5d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:56.607177 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b71314f-8a1f-465e-830b-045d8a23a5d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:56.939306 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9b71314f-8a1f-465e-830b-045d8a23a5d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:56.949635 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9b71314f-8a1f-465e-830b-045d8a23a5d2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1322 microversion: 2.1 time: 0.422402 Aug 03 10:44:56.950942 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 69/137] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:56 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:56.956545 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-e6a488d7-db24-47a7-a7c0-dd6a97645063 req-12af2b1d-2bef-4adb-953c-4ef50f8fb4de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbb281c5-ccf1-4de2-99fb-5201efd51b09", "tag": "908667e2-7286-4600-aa74-6161652b25ca"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:56.979562 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e6a488d7-db24-47a7-a7c0-dd6a97645063 req-12af2b1d-2bef-4adb-953c-4ef50f8fb4de service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:56.980722 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e6a488d7-db24-47a7-a7c0-dd6a97645063 req-12af2b1d-2bef-4adb-953c-4ef50f8fb4de service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:56.997227 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-e6a488d7-db24-47a7-a7c0-dd6a97645063 req-12af2b1d-2bef-4adb-953c-4ef50f8fb4de service nova] Creating event network-changed:908667e2-7286-4600-aa74-6161652b25ca for instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 on hv-cinder-85083 Aug 03 10:44:57.007400 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-e6a488d7-db24-47a7-a7c0-dd6a97645063 req-12af2b1d-2bef-4adb-953c-4ef50f8fb4de service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054526 Aug 03 10:44:57.010323 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 70/138] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:44:57.336950 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-59278fb7-d8cc-41ee-b0b9-667ebbd3f911 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "POST /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.820504 Aug 03 10:44:57.337902 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 69/139] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 3 10:44:55 2022] POST /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761/os-volume_attachments => generated 194 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:44:57.554486 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-86fe076e-e313-4cc5-91e0-32d383df8296 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:57.557137 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-86fe076e-e313-4cc5-91e0-32d383df8296 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:57.573115 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-86fe076e-e313-4cc5-91e0-32d383df8296 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:57.574685 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-86fe076e-e313-4cc5-91e0-32d383df8296 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:57.576158 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-86fe076e-e313-4cc5-91e0-32d383df8296 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:57.577542 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-86fe076e-e313-4cc5-91e0-32d383df8296 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:57.982988 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-7800bd60-211b-4ce8-8a20-ba5c6986f73d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:57.987192 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-7800bd60-211b-4ce8-8a20-ba5c6986f73d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:57.992962 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-86fe076e-e313-4cc5-91e0-32d383df8296 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:58.022139 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7800bd60-211b-4ce8-8a20-ba5c6986f73d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:58.022828 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7800bd60-211b-4ce8-8a20-ba5c6986f73d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:58.027899 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7800bd60-211b-4ce8-8a20-ba5c6986f73d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:58.030246 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7800bd60-211b-4ce8-8a20-ba5c6986f73d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:58.066154 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-86fe076e-e313-4cc5-91e0-32d383df8296 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:58.072311 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-86fe076e-e313-4cc5-91e0-32d383df8296 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:58.077655 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-86fe076e-e313-4cc5-91e0-32d383df8296 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1598 microversion: 2.20 time: 0.529679 Aug 03 10:44:58.093835 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 71/140] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:44:57 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1598 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:44:58.150674 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-195c24a2-b719-45f6-80ef-6e955055bb0f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:58.152651 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-195c24a2-b719-45f6-80ef-6e955055bb0f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:58.189969 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-195c24a2-b719-45f6-80ef-6e955055bb0f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:58.196233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-195c24a2-b719-45f6-80ef-6e955055bb0f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:58.199470 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-195c24a2-b719-45f6-80ef-6e955055bb0f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:58.204317 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-195c24a2-b719-45f6-80ef-6e955055bb0f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:58.536639 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-195c24a2-b719-45f6-80ef-6e955055bb0f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.404166 Aug 03 10:44:58.537686 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 72/141] 10.222.0.47 () {60 vars in 1316 bytes} [Wed Aug 3 10:44:58 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-interface => generated 284 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:44:58.579257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7800bd60-211b-4ce8-8a20-ba5c6986f73d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:58.592406 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-7800bd60-211b-4ce8-8a20-ba5c6986f73d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1517 microversion: 2.1 time: 0.623983 Aug 03 10:44:58.605638 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 70/142] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:57 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1517 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:44:58.627277 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-aad59974-741b-437e-9ddb-03e8ebe5dbc0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:44:58.629596 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-aad59974-741b-437e-9ddb-03e8ebe5dbc0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:58.641908 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aad59974-741b-437e-9ddb-03e8ebe5dbc0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:58.642510 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aad59974-741b-437e-9ddb-03e8ebe5dbc0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:58.645261 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aad59974-741b-437e-9ddb-03e8ebe5dbc0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:58.645950 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aad59974-741b-437e-9ddb-03e8ebe5dbc0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:58.676790 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-aad59974-741b-437e-9ddb-03e8ebe5dbc0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lazy-loading 'flavor' on Instance uuid ffac1966-f7c4-4029-89d1-2d7010eba5da {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:44:58.985636 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-aad59974-741b-437e-9ddb-03e8ebe5dbc0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "POST /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da/action" status: 200 len: 32 microversion: 2.1 time: 0.368522 Aug 03 10:44:58.989402 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 73/143] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 3 10:44:58 2022] POST /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da/action => generated 32 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 10:44:59.001069 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6e541164-4a62-4a0d-9d32-59ee7a892ea2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:44:59.002154 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6e541164-4a62-4a0d-9d32-59ee7a892ea2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:44:59.033113 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e541164-4a62-4a0d-9d32-59ee7a892ea2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:59.034028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e541164-4a62-4a0d-9d32-59ee7a892ea2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:59.035157 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e541164-4a62-4a0d-9d32-59ee7a892ea2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:44:59.035819 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e541164-4a62-4a0d-9d32-59ee7a892ea2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:44:59.447687 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-6e541164-4a62-4a0d-9d32-59ee7a892ea2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:44:59.465103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-6e541164-4a62-4a0d-9d32-59ee7a892ea2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.467667 Aug 03 10:44:59.465753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 71/144] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:44:58 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:00.502739 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-40e6f03f-0347-4968-892a-ebd17884468d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:00.504186 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-40e6f03f-0347-4968-892a-ebd17884468d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:00.511618 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40e6f03f-0347-4968-892a-ebd17884468d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:00.512452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40e6f03f-0347-4968-892a-ebd17884468d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:00.513595 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40e6f03f-0347-4968-892a-ebd17884468d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:00.514493 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40e6f03f-0347-4968-892a-ebd17884468d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:00.808328 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-40e6f03f-0347-4968-892a-ebd17884468d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:00.819553 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-40e6f03f-0347-4968-892a-ebd17884468d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.321216 Aug 03 10:45:00.820468 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 74/145] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:00 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:45:01.336839 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-5e7ef028-5b48-4b17-a406-00f45498c7c3 req-35ad5701-cb28-4c12-baa7-cde0407b570f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5895a291-434d-4b7c-85cd-0264cf37f5f3", "tag": "971e4968-4040-4784-a0ed-4c689d9711ff"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:45:01.359043 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-5e7ef028-5b48-4b17-a406-00f45498c7c3 req-35ad5701-cb28-4c12-baa7-cde0407b570f service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:01.360884 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-5e7ef028-5b48-4b17-a406-00f45498c7c3 req-35ad5701-cb28-4c12-baa7-cde0407b570f service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:01.381967 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-5e7ef028-5b48-4b17-a406-00f45498c7c3 req-35ad5701-cb28-4c12-baa7-cde0407b570f service nova] Creating event network-changed:971e4968-4040-4784-a0ed-4c689d9711ff for instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 on hv-cinder-85083 Aug 03 10:45:01.389414 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-5e7ef028-5b48-4b17-a406-00f45498c7c3 req-35ad5701-cb28-4c12-baa7-cde0407b570f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056544 Aug 03 10:45:01.390735 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 72/146] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:45:01.860668 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1e7b86c2-f384-4cbe-8b73-a3f5eb278d8d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:01.864107 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1e7b86c2-f384-4cbe-8b73-a3f5eb278d8d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:01.872484 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:45:01.874768 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1e7b86c2-f384-4cbe-8b73-a3f5eb278d8d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:01.876629 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1e7b86c2-f384-4cbe-8b73-a3f5eb278d8d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:01.878011 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1e7b86c2-f384-4cbe-8b73-a3f5eb278d8d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:01.879667 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1e7b86c2-f384-4cbe-8b73-a3f5eb278d8d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:02.243959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1e7b86c2-f384-4cbe-8b73-a3f5eb278d8d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:02.267098 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1e7b86c2-f384-4cbe-8b73-a3f5eb278d8d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.422820 Aug 03 10:45:02.283041 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 75/147] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:01 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:03.297962 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-76460ef5-f010-4834-8a67-19c94c50f8e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:03.298862 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-76460ef5-f010-4834-8a67-19c94c50f8e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:03.311084 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-76460ef5-f010-4834-8a67-19c94c50f8e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:03.318024 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-76460ef5-f010-4834-8a67-19c94c50f8e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:03.320569 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-76460ef5-f010-4834-8a67-19c94c50f8e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:03.323870 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-76460ef5-f010-4834-8a67-19c94c50f8e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:03.603348 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-76460ef5-f010-4834-8a67-19c94c50f8e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:03.613418 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-76460ef5-f010-4834-8a67-19c94c50f8e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.323172 Aug 03 10:45:03.614589 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 73/148] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:03 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:45:04.643195 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7de8f53b-8324-499c-a6d1-80325f1b5618 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:04.652597 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7de8f53b-8324-499c-a6d1-80325f1b5618 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:04.663046 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7de8f53b-8324-499c-a6d1-80325f1b5618 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:04.663644 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7de8f53b-8324-499c-a6d1-80325f1b5618 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:04.666113 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7de8f53b-8324-499c-a6d1-80325f1b5618 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:04.666732 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7de8f53b-8324-499c-a6d1-80325f1b5618 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:04.908017 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7de8f53b-8324-499c-a6d1-80325f1b5618 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:04.918190 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7de8f53b-8324-499c-a6d1-80325f1b5618 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.284239 Aug 03 10:45:04.919686 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 76/149] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:04 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:05.948186 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-24922dc8-e716-4d06-8874-414f0f847a5e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:05.949430 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-24922dc8-e716-4d06-8874-414f0f847a5e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:05.974881 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-24922dc8-e716-4d06-8874-414f0f847a5e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:05.975479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-24922dc8-e716-4d06-8874-414f0f847a5e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:05.976326 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-24922dc8-e716-4d06-8874-414f0f847a5e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:05.976771 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-24922dc8-e716-4d06-8874-414f0f847a5e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:06.415829 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-24922dc8-e716-4d06-8874-414f0f847a5e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:06.424960 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-24922dc8-e716-4d06-8874-414f0f847a5e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.480896 Aug 03 10:45:06.426510 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 74/150] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:05 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:07.465352 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7d10d642-b342-4b29-8988-c9803fbf7816 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:07.466608 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7d10d642-b342-4b29-8988-c9803fbf7816 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:07.474326 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d10d642-b342-4b29-8988-c9803fbf7816 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:07.474777 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d10d642-b342-4b29-8988-c9803fbf7816 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:07.475580 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d10d642-b342-4b29-8988-c9803fbf7816 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:07.476020 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d10d642-b342-4b29-8988-c9803fbf7816 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:07.480371 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:45:07.621007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7d10d642-b342-4b29-8988-c9803fbf7816 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:07.629591 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7d10d642-b342-4b29-8988-c9803fbf7816 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.170672 Aug 03 10:45:07.630214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 77/151] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:07 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:08.652012 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e09d3527-7e5c-42ab-93d7-173b531d5b1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:08.652975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e09d3527-7e5c-42ab-93d7-173b531d5b1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:08.664332 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e09d3527-7e5c-42ab-93d7-173b531d5b1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:08.664874 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e09d3527-7e5c-42ab-93d7-173b531d5b1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:08.665985 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e09d3527-7e5c-42ab-93d7-173b531d5b1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:08.666571 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e09d3527-7e5c-42ab-93d7-173b531d5b1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:08.851114 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e09d3527-7e5c-42ab-93d7-173b531d5b1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:08.864267 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e09d3527-7e5c-42ab-93d7-173b531d5b1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.216414 Aug 03 10:45:08.869931 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 75/152] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:08 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:09.897768 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e09c19f7-b28d-4d2c-9305-f3df37d1937c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:09.898544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e09c19f7-b28d-4d2c-9305-f3df37d1937c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:09.906296 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e09c19f7-b28d-4d2c-9305-f3df37d1937c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:09.906743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e09c19f7-b28d-4d2c-9305-f3df37d1937c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:09.907671 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e09c19f7-b28d-4d2c-9305-f3df37d1937c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:09.908319 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e09c19f7-b28d-4d2c-9305-f3df37d1937c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:10.069602 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e09c19f7-b28d-4d2c-9305-f3df37d1937c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:10.077973 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e09c19f7-b28d-4d2c-9305-f3df37d1937c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.184319 Aug 03 10:45:10.078575 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 78/153] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:09 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:11.100933 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-506d2020-3af8-463b-844b-8e61e2f6788e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:11.101642 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-506d2020-3af8-463b-844b-8e61e2f6788e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:11.108848 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-506d2020-3af8-463b-844b-8e61e2f6788e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:11.109296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-506d2020-3af8-463b-844b-8e61e2f6788e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:11.110116 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-506d2020-3af8-463b-844b-8e61e2f6788e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:11.110548 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-506d2020-3af8-463b-844b-8e61e2f6788e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:11.266790 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-506d2020-3af8-463b-844b-8e61e2f6788e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:11.275016 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-506d2020-3af8-463b-844b-8e61e2f6788e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.179117 Aug 03 10:45:11.275609 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 76/154] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:11 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:12.300340 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8ee232d8-f2d4-4e68-9463-43d70814738a tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:12.301210 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8ee232d8-f2d4-4e68-9463-43d70814738a tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:12.309351 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8ee232d8-f2d4-4e68-9463-43d70814738a tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:12.309931 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8ee232d8-f2d4-4e68-9463-43d70814738a tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:12.310789 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8ee232d8-f2d4-4e68-9463-43d70814738a tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:12.311297 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8ee232d8-f2d4-4e68-9463-43d70814738a tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:12.454911 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8ee232d8-f2d4-4e68-9463-43d70814738a tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:12.463406 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8ee232d8-f2d4-4e68-9463-43d70814738a tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.169081 Aug 03 10:45:12.464008 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 79/155] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:12 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:12.734196 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-8b1d7c0f-190e-4978-a126-569e2517d807 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:12.735213 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-8b1d7c0f-190e-4978-a126-569e2517d807 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:12.744842 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8b1d7c0f-190e-4978-a126-569e2517d807 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:12.745391 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8b1d7c0f-190e-4978-a126-569e2517d807 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:12.748769 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8b1d7c0f-190e-4978-a126-569e2517d807 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:12.749248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8b1d7c0f-190e-4978-a126-569e2517d807 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:12.778242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-8b1d7c0f-190e-4978-a126-569e2517d807 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Going to try to terminate instance {{(pid=124389) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:45:12.882284 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-8b1d7c0f-190e-4978-a126-569e2517d807 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 204 len: 0 microversion: 2.1 time: 0.153425 Aug 03 10:45:12.882939 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 77/156] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:45:12 2022] DELETE /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:45:12.893153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-adb20560-abb8-4673-afef-2001277a1ff6 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:12.894214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-adb20560-abb8-4673-afef-2001277a1ff6 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:12.902696 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-adb20560-abb8-4673-afef-2001277a1ff6 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:12.903082 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-adb20560-abb8-4673-afef-2001277a1ff6 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:12.903886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-adb20560-abb8-4673-afef-2001277a1ff6 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:12.904456 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-adb20560-abb8-4673-afef-2001277a1ff6 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:13.097017 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-adb20560-abb8-4673-afef-2001277a1ff6 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:13.106601 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-adb20560-abb8-4673-afef-2001277a1ff6 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1552 microversion: 2.1 time: 0.218570 Aug 03 10:45:13.107253 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 80/157] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:12 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1552 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:13.490350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-cf0a3da2-11b9-445a-b7b1-0733ea19cd7c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:13.491270 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-cf0a3da2-11b9-445a-b7b1-0733ea19cd7c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:13.500197 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cf0a3da2-11b9-445a-b7b1-0733ea19cd7c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:13.500799 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cf0a3da2-11b9-445a-b7b1-0733ea19cd7c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:13.501873 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cf0a3da2-11b9-445a-b7b1-0733ea19cd7c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:13.502415 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cf0a3da2-11b9-445a-b7b1-0733ea19cd7c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:13.715447 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-cf0a3da2-11b9-445a-b7b1-0733ea19cd7c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:13.723851 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-cf0a3da2-11b9-445a-b7b1-0733ea19cd7c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.239616 Aug 03 10:45:13.724444 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 78/158] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:13 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:14.129073 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-04b57722-d97f-4623-a1a8-07b227b3a21b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:14.129831 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-04b57722-d97f-4623-a1a8-07b227b3a21b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:14.136270 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-04b57722-d97f-4623-a1a8-07b227b3a21b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:14.136721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-04b57722-d97f-4623-a1a8-07b227b3a21b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:14.137540 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-04b57722-d97f-4623-a1a8-07b227b3a21b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:14.137977 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-04b57722-d97f-4623-a1a8-07b227b3a21b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:14.296124 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-04b57722-d97f-4623-a1a8-07b227b3a21b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:14.306351 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-04b57722-d97f-4623-a1a8-07b227b3a21b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1552 microversion: 2.1 time: 0.181538 Aug 03 10:45:14.306965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 81/159] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:14 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1552 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:14.745369 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-35d42f74-03b2-44ec-9cdc-9f95828cdf86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:14.746093 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-35d42f74-03b2-44ec-9cdc-9f95828cdf86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:14.752411 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-35d42f74-03b2-44ec-9cdc-9f95828cdf86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:14.752861 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-35d42f74-03b2-44ec-9cdc-9f95828cdf86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:14.754391 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-35d42f74-03b2-44ec-9cdc-9f95828cdf86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:14.754752 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-35d42f74-03b2-44ec-9cdc-9f95828cdf86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:14.900239 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-35d42f74-03b2-44ec-9cdc-9f95828cdf86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:14.907667 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-35d42f74-03b2-44ec-9cdc-9f95828cdf86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.166355 Aug 03 10:45:14.908280 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 79/160] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:14 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:15.334505 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-77b047e2-ff86-467b-b9c6-fe63f73fd73e tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:15.336816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-77b047e2-ff86-467b-b9c6-fe63f73fd73e tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:15.344078 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-77b047e2-ff86-467b-b9c6-fe63f73fd73e tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:15.344586 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-77b047e2-ff86-467b-b9c6-fe63f73fd73e tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:15.345843 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-77b047e2-ff86-467b-b9c6-fe63f73fd73e tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:15.345959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-77b047e2-ff86-467b-b9c6-fe63f73fd73e tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:15.483621 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-77b047e2-ff86-467b-b9c6-fe63f73fd73e tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:15.494350 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-77b047e2-ff86-467b-b9c6-fe63f73fd73e tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1552 microversion: 2.1 time: 0.164195 Aug 03 10:45:15.494946 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 82/161] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:15 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:15.929548 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1acaa600-b8cb-4b31-88d7-a7e7c68a34d1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:15.930152 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-1acaa600-b8cb-4b31-88d7-a7e7c68a34d1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:15.937557 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1acaa600-b8cb-4b31-88d7-a7e7c68a34d1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:15.938026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1acaa600-b8cb-4b31-88d7-a7e7c68a34d1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:15.938783 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1acaa600-b8cb-4b31-88d7-a7e7c68a34d1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:15.939222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1acaa600-b8cb-4b31-88d7-a7e7c68a34d1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:15.959718 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:45:16.086294 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1acaa600-b8cb-4b31-88d7-a7e7c68a34d1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:16.094397 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1acaa600-b8cb-4b31-88d7-a7e7c68a34d1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.169321 Aug 03 10:45:16.095105 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 80/162] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:15 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:16.515777 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b3ffc167-e406-4290-a7fa-883b9d35dd1f tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:16.516394 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b3ffc167-e406-4290-a7fa-883b9d35dd1f tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:16.523910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b3ffc167-e406-4290-a7fa-883b9d35dd1f tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:16.524374 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b3ffc167-e406-4290-a7fa-883b9d35dd1f tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:16.525216 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b3ffc167-e406-4290-a7fa-883b9d35dd1f tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:16.525693 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b3ffc167-e406-4290-a7fa-883b9d35dd1f tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:16.665515 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b3ffc167-e406-4290-a7fa-883b9d35dd1f tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:16.674234 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b3ffc167-e406-4290-a7fa-883b9d35dd1f tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1552 microversion: 2.1 time: 0.162494 Aug 03 10:45:16.674814 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 83/163] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:16 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:17.116209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2db6109d-6875-48bc-b008-548fdc19e7f2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:17.116839 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2db6109d-6875-48bc-b008-548fdc19e7f2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:17.123550 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2db6109d-6875-48bc-b008-548fdc19e7f2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:17.123999 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2db6109d-6875-48bc-b008-548fdc19e7f2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:17.124814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2db6109d-6875-48bc-b008-548fdc19e7f2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:17.125247 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2db6109d-6875-48bc-b008-548fdc19e7f2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:17.282019 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2db6109d-6875-48bc-b008-548fdc19e7f2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:17.289743 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2db6109d-6875-48bc-b008-548fdc19e7f2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.177432 Aug 03 10:45:17.290312 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 81/164] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:17 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:17.698471 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c0d37a99-951b-453a-bd48-d42dad59450b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:17.699090 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c0d37a99-951b-453a-bd48-d42dad59450b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:17.705857 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c0d37a99-951b-453a-bd48-d42dad59450b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:17.706312 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c0d37a99-951b-453a-bd48-d42dad59450b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:17.707201 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c0d37a99-951b-453a-bd48-d42dad59450b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:17.707643 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c0d37a99-951b-453a-bd48-d42dad59450b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:17.855291 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c0d37a99-951b-453a-bd48-d42dad59450b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:17.864562 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c0d37a99-951b-453a-bd48-d42dad59450b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1552 microversion: 2.1 time: 0.169897 Aug 03 10:45:17.865475 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 84/165] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:17 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:18.311908 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-406bc21e-d531-4a0d-99c7-43d86b03bbaa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:18.312603 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-406bc21e-d531-4a0d-99c7-43d86b03bbaa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:18.320245 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-406bc21e-d531-4a0d-99c7-43d86b03bbaa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:18.320769 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-406bc21e-d531-4a0d-99c7-43d86b03bbaa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:18.321585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-406bc21e-d531-4a0d-99c7-43d86b03bbaa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:18.322240 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-406bc21e-d531-4a0d-99c7-43d86b03bbaa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:18.528944 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-406bc21e-d531-4a0d-99c7-43d86b03bbaa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:18.543916 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-406bc21e-d531-4a0d-99c7-43d86b03bbaa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.232055 Aug 03 10:45:18.543916 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 82/166] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:18 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:18.636283 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-44c29fd8-d7c2-453c-9c2b-0ff78e7bef49 req-61337a77-68cb-43c1-adae-302f02a8eee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8ef6f9-29fe-4627-9bed-212ed8006761", "name": "network-vif-deleted", "tag": "e942a2d5-2eea-4a00-b545-1474d8da6cce"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:45:18.668078 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-44c29fd8-d7c2-453c-9c2b-0ff78e7bef49 req-61337a77-68cb-43c1-adae-302f02a8eee8 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:18.668783 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-44c29fd8-d7c2-453c-9c2b-0ff78e7bef49 req-61337a77-68cb-43c1-adae-302f02a8eee8 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:18.687973 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-44c29fd8-d7c2-453c-9c2b-0ff78e7bef49 req-61337a77-68cb-43c1-adae-302f02a8eee8 service nova] Creating event network-vif-deleted:e942a2d5-2eea-4a00-b545-1474d8da6cce for instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 on hv-cinder-85083 Aug 03 10:45:18.693935 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-44c29fd8-d7c2-453c-9c2b-0ff78e7bef49 req-61337a77-68cb-43c1-adae-302f02a8eee8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065243 Aug 03 10:45:18.695596 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 85/167] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:45:18.896225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3614fbc1-c9fa-4a67-ac09-9ef05a6c5b71 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:18.897407 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3614fbc1-c9fa-4a67-ac09-9ef05a6c5b71 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:18.909111 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3614fbc1-c9fa-4a67-ac09-9ef05a6c5b71 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:18.910499 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3614fbc1-c9fa-4a67-ac09-9ef05a6c5b71 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:18.911523 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3614fbc1-c9fa-4a67-ac09-9ef05a6c5b71 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:18.912033 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3614fbc1-c9fa-4a67-ac09-9ef05a6c5b71 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:19.010613 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3614fbc1-c9fa-4a67-ac09-9ef05a6c5b71 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd560ec3b091c4baab93c4abb5fabd287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab735db52f2e420e9aeba9387484dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:19.035179 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3614fbc1-c9fa-4a67-ac09-9ef05a6c5b71 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 200 len: 1345 microversion: 2.1 time: 0.151486 Aug 03 10:45:19.045553 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 83/168] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:18 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 1345 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:19.583880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-303dae68-0301-43ee-b375-fb1469f7efd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:19.588304 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-303dae68-0301-43ee-b375-fb1469f7efd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:19.601975 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-303dae68-0301-43ee-b375-fb1469f7efd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:19.602933 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-303dae68-0301-43ee-b375-fb1469f7efd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:19.607013 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-303dae68-0301-43ee-b375-fb1469f7efd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:19.607923 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-303dae68-0301-43ee-b375-fb1469f7efd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:19.875161 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-303dae68-0301-43ee-b375-fb1469f7efd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:19.890591 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-303dae68-0301-43ee-b375-fb1469f7efd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.315099 Aug 03 10:45:19.892906 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 86/169] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:19 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:20.063775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-777eb536-0d17-4876-b13c-297725ef87db tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:20.064877 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-777eb536-0d17-4876-b13c-297725ef87db tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:20.076255 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-777eb536-0d17-4876-b13c-297725ef87db tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:20.076825 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-777eb536-0d17-4876-b13c-297725ef87db tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:20.078452 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-777eb536-0d17-4876-b13c-297725ef87db tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:20.078962 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-777eb536-0d17-4876-b13c-297725ef87db tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:20.093580 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-777eb536-0d17-4876-b13c-297725ef87db tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] HTTP exception thrown: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-777eb536-0d17-4876-b13c-297725ef87db tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Request method failure captured: Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 HTTP/1.1 Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lFxbrPYEvjWEGIOL7KQR6wRGVBQdrVsgDJQ3ni9Vz-1bygyjq8SHZ7T-X6F8TDjQCuVAtp4EhLJ3PCdb9p3txd2Plf2HgQWZfMp4VHUUGaNiuvng-RyQhccwziZMpuoxtLGIyetmMahFXC6vJrCnMaJw0W31W9BkGxY-hwaYZWREQQ Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: ab735db52f2e420e9aeba9387484dd07 Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-DeleteServersTestJSON-908001745 Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:45:20.104733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:45:20.106261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab735db52f2e420e9aeba9387484dd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ab735db52f2e420e9aeba9387484dd07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab735db52f2e420e9aeba9387484dd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ab735db52f2e420e9aeba9387484dd07", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:45:20.106261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-DeleteServersTestJSON-908001745 Aug 03 10:45:20.106261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: ab735db52f2e420e9aeba9387484dd07 Aug 03 10:45:20.106261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-DeleteServersTestJSON-908001745 Aug 03 10:45:20.106261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-DeleteServersTestJSON-908001745-project Aug 03 10:45:20.106261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:45:20.106261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:45:20.106261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: d560ec3b091c4baab93c4abb5fabd287 Aug 03 10:45:20.106261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-DeleteServersTestJSON-908001745-project Aug 03 10:45:20.106261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:45:20.106261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:20.106261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '8f8ef6f9-29fe-4627-9bed-212ed8006761'} Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:45:20.107053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:20.108620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:45:20.109809 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-777eb536-0d17-4876-b13c-297725ef87db tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Returning 404 to user: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:45:20.109809 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-777eb536-0d17-4876-b13c-297725ef87db tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 404 len: 111 microversion: 2.1 time: 0.050371 Aug 03 10:45:20.109809 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 84/170] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:20 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:45:20.233636 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ed3a97f4-9a4d-4f70-953e-a0f5ee6abd33 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:20.236415 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ed3a97f4-9a4d-4f70-953e-a0f5ee6abd33 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:20.245306 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ed3a97f4-9a4d-4f70-953e-a0f5ee6abd33 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:20.245861 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ed3a97f4-9a4d-4f70-953e-a0f5ee6abd33 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:20.246683 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ed3a97f4-9a4d-4f70-953e-a0f5ee6abd33 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:20.247127 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ed3a97f4-9a4d-4f70-953e-a0f5ee6abd33 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:20.261627 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-ed3a97f4-9a4d-4f70-953e-a0f5ee6abd33 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] HTTP exception thrown: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ed3a97f4-9a4d-4f70-953e-a0f5ee6abd33 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Request method failure captured: Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761/os-volume_attachments HTTP/1.1 Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFxbrPYEvjWEGIOL7KQR6wRGVBQdrVsgDJQ3ni9Vz-1bygyjq8SHZ7T-X6F8TDjQCuVAtp4EhLJ3PCdb9p3txd2Plf2HgQWZfMp4VHUUGaNiuvng-RyQhccwziZMpuoxtLGIyetmMahFXC6vJrCnMaJw0W31W9BkGxY-hwaYZWREQQ Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: ab735db52f2e420e9aeba9387484dd07 Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-DeleteServersTestJSON-908001745 Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:45:20.266864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:45:20.269684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab735db52f2e420e9aeba9387484dd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ab735db52f2e420e9aeba9387484dd07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab735db52f2e420e9aeba9387484dd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ab735db52f2e420e9aeba9387484dd07", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:45:20.269684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-DeleteServersTestJSON-908001745 Aug 03 10:45:20.269684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: ab735db52f2e420e9aeba9387484dd07 Aug 03 10:45:20.269684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-DeleteServersTestJSON-908001745 Aug 03 10:45:20.269684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-DeleteServersTestJSON-908001745-project Aug 03 10:45:20.269684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:45:20.269684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:45:20.269684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: d560ec3b091c4baab93c4abb5fabd287 Aug 03 10:45:20.269684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-DeleteServersTestJSON-908001745-project Aug 03 10:45:20.269684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:45:20.269684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:20.269684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'server_id': '8f8ef6f9-29fe-4627-9bed-212ed8006761'} Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:45:20.271333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:20.273648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:45:20.275259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ed3a97f4-9a4d-4f70-953e-a0f5ee6abd33 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Returning 404 to user: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:45:20.275259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ed3a97f4-9a4d-4f70-953e-a0f5ee6abd33 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039412 Aug 03 10:45:20.275259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 87/171] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:45:20 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:45:20.917068 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-10d2ab9f-d4dd-4854-97da-de5fa8584704 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:20.918026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-10d2ab9f-d4dd-4854-97da-de5fa8584704 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:20.928612 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-10d2ab9f-d4dd-4854-97da-de5fa8584704 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:20.929076 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-10d2ab9f-d4dd-4854-97da-de5fa8584704 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:20.930269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-10d2ab9f-d4dd-4854-97da-de5fa8584704 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:20.930715 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-10d2ab9f-d4dd-4854-97da-de5fa8584704 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:21.103744 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-10d2ab9f-d4dd-4854-97da-de5fa8584704 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:21.114224 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-10d2ab9f-d4dd-4854-97da-de5fa8584704 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.200463 Aug 03 10:45:21.114826 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 85/172] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:20 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:22.136878 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6a0ad0f2-dce5-42d9-9aae-836ad3a44ab3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:22.137587 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6a0ad0f2-dce5-42d9-9aae-836ad3a44ab3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:22.140969 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=56 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:45:22.145649 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6a0ad0f2-dce5-42d9-9aae-836ad3a44ab3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:22.146100 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6a0ad0f2-dce5-42d9-9aae-836ad3a44ab3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:22.146891 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6a0ad0f2-dce5-42d9-9aae-836ad3a44ab3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:22.147326 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6a0ad0f2-dce5-42d9-9aae-836ad3a44ab3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:22.345785 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6a0ad0f2-dce5-42d9-9aae-836ad3a44ab3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:22.354787 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6a0ad0f2-dce5-42d9-9aae-836ad3a44ab3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.221808 Aug 03 10:45:22.355385 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 88/173] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:22 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:23.377660 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-11c52a39-2332-4976-8535-5836392c5567 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:23.379531 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-11c52a39-2332-4976-8535-5836392c5567 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:23.386028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:45:23.388508 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-11c52a39-2332-4976-8535-5836392c5567 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:23.389164 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-11c52a39-2332-4976-8535-5836392c5567 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:23.390155 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-11c52a39-2332-4976-8535-5836392c5567 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:23.390750 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-11c52a39-2332-4976-8535-5836392c5567 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:23.620038 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-11c52a39-2332-4976-8535-5836392c5567 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:23.630353 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-11c52a39-2332-4976-8535-5836392c5567 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.256634 Aug 03 10:45:23.630936 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 86/174] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:23 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:45:24.654065 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-89a71288-9715-4bef-97ed-76b776dc64cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:24.655632 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-89a71288-9715-4bef-97ed-76b776dc64cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:24.672059 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-89a71288-9715-4bef-97ed-76b776dc64cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:24.674080 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-89a71288-9715-4bef-97ed-76b776dc64cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:24.675503 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-89a71288-9715-4bef-97ed-76b776dc64cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:24.676220 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-89a71288-9715-4bef-97ed-76b776dc64cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:24.745645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-08815d52-7f03-41bc-b4d6-86505082768b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:24.748384 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-08815d52-7f03-41bc-b4d6-86505082768b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:24.765289 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-08815d52-7f03-41bc-b4d6-86505082768b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:24.766670 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-08815d52-7f03-41bc-b4d6-86505082768b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:24.767863 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-08815d52-7f03-41bc-b4d6-86505082768b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:24.768520 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-08815d52-7f03-41bc-b4d6-86505082768b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:24.786491 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-08815d52-7f03-41bc-b4d6-86505082768b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] HTTP exception thrown: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-08815d52-7f03-41bc-b4d6-86505082768b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Request method failure captured: Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: DELETE /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 HTTP/1.1 Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lFxbrPYEvjWEGIOL7KQR6wRGVBQdrVsgDJQ3ni9Vz-1bygyjq8SHZ7T-X6F8TDjQCuVAtp4EhLJ3PCdb9p3txd2Plf2HgQWZfMp4VHUUGaNiuvng-RyQhccwziZMpuoxtLGIyetmMahFXC6vJrCnMaJw0W31W9BkGxY-hwaYZWREQQ Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: ab735db52f2e420e9aeba9387484dd07 Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-DeleteServersTestJSON-908001745 Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:45:24.788966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:45:24.790515 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab735db52f2e420e9aeba9387484dd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ab735db52f2e420e9aeba9387484dd07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab735db52f2e420e9aeba9387484dd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ab735db52f2e420e9aeba9387484dd07", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:45:24.790515 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-DeleteServersTestJSON-908001745 Aug 03 10:45:24.790515 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: ab735db52f2e420e9aeba9387484dd07 Aug 03 10:45:24.790515 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-DeleteServersTestJSON-908001745 Aug 03 10:45:24.790515 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-DeleteServersTestJSON-908001745-project Aug 03 10:45:24.790515 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:45:24.790515 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:45:24.790515 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: d560ec3b091c4baab93c4abb5fabd287 Aug 03 10:45:24.790515 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-DeleteServersTestJSON-908001745-project Aug 03 10:45:24.790515 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:45:24.790515 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:24.790515 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '8f8ef6f9-29fe-4627-9bed-212ed8006761'} Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:45:24.791209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:24.792222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:45:24.793263 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-08815d52-7f03-41bc-b4d6-86505082768b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Returning 404 to user: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:45:24.793263 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-08815d52-7f03-41bc-b4d6-86505082768b tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 404 len: 111 microversion: 2.1 time: 0.057833 Aug 03 10:45:24.793263 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 87/175] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:45:24 2022] DELETE /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:45:24.800365 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-44c262df-0f2a-4a48-9852-55630c7a4122 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:24.800991 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-44c262df-0f2a-4a48-9852-55630c7a4122 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] [instance: 8f8ef6f9-29fe-4627-9bed-212ed8006761] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:24.807990 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-44c262df-0f2a-4a48-9852-55630c7a4122 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:24.809341 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-44c262df-0f2a-4a48-9852-55630c7a4122 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:24.810393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-44c262df-0f2a-4a48-9852-55630c7a4122 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:24.811029 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-44c262df-0f2a-4a48-9852-55630c7a4122 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:24.828127 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-44c262df-0f2a-4a48-9852-55630c7a4122 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] HTTP exception thrown: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-44c262df-0f2a-4a48-9852-55630c7a4122 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Request method failure captured: Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 HTTP/1.1 Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lFxbrPYEvjWEGIOL7KQR6wRGVBQdrVsgDJQ3ni9Vz-1bygyjq8SHZ7T-X6F8TDjQCuVAtp4EhLJ3PCdb9p3txd2Plf2HgQWZfMp4VHUUGaNiuvng-RyQhccwziZMpuoxtLGIyetmMahFXC6vJrCnMaJw0W31W9BkGxY-hwaYZWREQQ Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: ab735db52f2e420e9aeba9387484dd07 Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-DeleteServersTestJSON-908001745 Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:45:24.830004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:45:24.832025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab735db52f2e420e9aeba9387484dd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ab735db52f2e420e9aeba9387484dd07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab735db52f2e420e9aeba9387484dd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ab735db52f2e420e9aeba9387484dd07", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:45:24.832025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-DeleteServersTestJSON-908001745 Aug 03 10:45:24.832025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: ab735db52f2e420e9aeba9387484dd07 Aug 03 10:45:24.832025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-DeleteServersTestJSON-908001745 Aug 03 10:45:24.832025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-DeleteServersTestJSON-908001745-project Aug 03 10:45:24.832025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:45:24.832025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:45:24.832025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: d560ec3b091c4baab93c4abb5fabd287 Aug 03 10:45:24.832025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-DeleteServersTestJSON-908001745-project Aug 03 10:45:24.832025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:45:24.832025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:24.832025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '8f8ef6f9-29fe-4627-9bed-212ed8006761'} Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:45:24.832831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. Aug 03 10:45:24.834317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:45:24.837024 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-44c262df-0f2a-4a48-9852-55630c7a4122 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] Returning 404 to user: Instance 8f8ef6f9-29fe-4627-9bed-212ed8006761 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:45:24.837024 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-44c262df-0f2a-4a48-9852-55630c7a4122 tempest-DeleteServersTestJSON-908001745 tempest-DeleteServersTestJSON-908001745-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761" status: 404 len: 111 microversion: 2.1 time: 0.036028 Aug 03 10:45:24.837024 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 88/176] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:24 2022] GET /compute/v2.1/servers/8f8ef6f9-29fe-4627-9bed-212ed8006761 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:45:24.978617 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-89a71288-9715-4bef-97ed-76b776dc64cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:24.992135 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-89a71288-9715-4bef-97ed-76b776dc64cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.341441 Aug 03 10:45:25.010235 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 89/177] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:24 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:26.017809 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3f393194-b341-4b93-9d14-6897567db3e0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:26.018429 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3f393194-b341-4b93-9d14-6897567db3e0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:26.028839 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3f393194-b341-4b93-9d14-6897567db3e0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:26.030083 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3f393194-b341-4b93-9d14-6897567db3e0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:26.035345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3f393194-b341-4b93-9d14-6897567db3e0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:26.035982 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3f393194-b341-4b93-9d14-6897567db3e0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:26.400260 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3f393194-b341-4b93-9d14-6897567db3e0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:26.430112 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3f393194-b341-4b93-9d14-6897567db3e0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.416046 Aug 03 10:45:26.434069 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 89/178] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:26 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:27.468469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-78557c8a-ba43-4856-adc1-c528b9a8068f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:27.469093 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-78557c8a-ba43-4856-adc1-c528b9a8068f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:27.478560 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-78557c8a-ba43-4856-adc1-c528b9a8068f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:27.478921 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-78557c8a-ba43-4856-adc1-c528b9a8068f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:27.481001 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-78557c8a-ba43-4856-adc1-c528b9a8068f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:27.482160 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-78557c8a-ba43-4856-adc1-c528b9a8068f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:27.731528 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-78557c8a-ba43-4856-adc1-c528b9a8068f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:27.745918 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-78557c8a-ba43-4856-adc1-c528b9a8068f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.279871 Aug 03 10:45:27.747418 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 90/179] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:27 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:45:28.769424 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4ff1d2ae-ea03-4ce4-bba9-2daa0d4ef761 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:28.770874 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4ff1d2ae-ea03-4ce4-bba9-2daa0d4ef761 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:28.780942 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4ff1d2ae-ea03-4ce4-bba9-2daa0d4ef761 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:28.781809 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4ff1d2ae-ea03-4ce4-bba9-2daa0d4ef761 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:28.782772 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4ff1d2ae-ea03-4ce4-bba9-2daa0d4ef761 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:28.783364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4ff1d2ae-ea03-4ce4-bba9-2daa0d4ef761 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:29.184268 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4ff1d2ae-ea03-4ce4-bba9-2daa0d4ef761 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:29.201760 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-4ff1d2ae-ea03-4ce4-bba9-2daa0d4ef761 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.435784 Aug 03 10:45:29.203212 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 90/180] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:28 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:30.247555 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-510ef265-cf7e-4cc6-9a23-10e7ce01bc86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:30.252223 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-510ef265-cf7e-4cc6-9a23-10e7ce01bc86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:30.270553 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-510ef265-cf7e-4cc6-9a23-10e7ce01bc86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:30.272405 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-510ef265-cf7e-4cc6-9a23-10e7ce01bc86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:30.274193 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-510ef265-cf7e-4cc6-9a23-10e7ce01bc86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:30.275939 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-510ef265-cf7e-4cc6-9a23-10e7ce01bc86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:31.411219 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-510ef265-cf7e-4cc6-9a23-10e7ce01bc86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:31.420159 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-510ef265-cf7e-4cc6-9a23-10e7ce01bc86 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 1.180311 Aug 03 10:45:31.422259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 91/181] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:30 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:32.447059 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e67a7ac4-9a6a-4f4c-aad3-9af47df3e2bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:32.448291 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e67a7ac4-9a6a-4f4c-aad3-9af47df3e2bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:32.465228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e67a7ac4-9a6a-4f4c-aad3-9af47df3e2bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:32.470215 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e67a7ac4-9a6a-4f4c-aad3-9af47df3e2bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:32.476943 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e67a7ac4-9a6a-4f4c-aad3-9af47df3e2bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:32.477404 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e67a7ac4-9a6a-4f4c-aad3-9af47df3e2bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:33.158933 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e67a7ac4-9a6a-4f4c-aad3-9af47df3e2bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:33.167837 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e67a7ac4-9a6a-4f4c-aad3-9af47df3e2bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1523 microversion: 2.1 time: 0.724727 Aug 03 10:45:33.171089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 91/182] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:32 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1523 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:34.193765 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-898ab170-064d-4891-9fcd-70d221b4faed tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:34.194564 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-898ab170-064d-4891-9fcd-70d221b4faed tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:34.203871 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-898ab170-064d-4891-9fcd-70d221b4faed tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:34.204869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-898ab170-064d-4891-9fcd-70d221b4faed tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:34.206283 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-898ab170-064d-4891-9fcd-70d221b4faed tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:34.206973 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-898ab170-064d-4891-9fcd-70d221b4faed tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:34.606092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-898ab170-064d-4891-9fcd-70d221b4faed tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:34.626991 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-898ab170-064d-4891-9fcd-70d221b4faed tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1503 microversion: 2.1 time: 0.436973 Aug 03 10:45:34.629497 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 92/183] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:34 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1503 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:34.655809 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-977de02c-19e0-488a-9f11-ec7b675810a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:34.656406 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-977de02c-19e0-488a-9f11-ec7b675810a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:34.667387 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-977de02c-19e0-488a-9f11-ec7b675810a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:34.667841 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-977de02c-19e0-488a-9f11-ec7b675810a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:34.668621 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-977de02c-19e0-488a-9f11-ec7b675810a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:34.672199 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-977de02c-19e0-488a-9f11-ec7b675810a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:35.273216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-977de02c-19e0-488a-9f11-ec7b675810a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:35.287167 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-977de02c-19e0-488a-9f11-ec7b675810a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1516 microversion: 2.1 time: 0.637557 Aug 03 10:45:35.288243 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 92/184] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:34 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1516 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:37.035181 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0dd6d37d-357d-4648-8305-9176f600c661 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] Calling method '.version_select at 0x7fbd107d1280>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:37.161611 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0dd6d37d-357d-4648-8305-9176f600c661 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e1e921a3-4f07-40d6-a686-0b4ee5781846" status: 200 len: 350 microversion: 2.1 time: 0.133487 Aug 03 10:45:37.171741 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 93/185] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 3 10:45:37 2022] GET /compute/v2.1/os-volumes/e1e921a3-4f07-40d6-a686-0b4ee5781846 => generated 350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:45:37.275365 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e437c8e1-59af-4865-bb3e-388fd70efd6f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:45:37.278038 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e437c8e1-59af-4865-bb3e-388fd70efd6f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:37.297049 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e437c8e1-59af-4865-bb3e-388fd70efd6f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:37.303075 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e437c8e1-59af-4865-bb3e-388fd70efd6f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:37.306402 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e437c8e1-59af-4865-bb3e-388fd70efd6f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:37.307335 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e437c8e1-59af-4865-bb3e-388fd70efd6f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:37.358192 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-e437c8e1-59af-4865-bb3e-388fd70efd6f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lazy-loading 'flavor' on Instance uuid da275cd5-e209-45c5-a46e-3082d668a6b5 {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:45:37.767814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e437c8e1-59af-4865-bb3e-388fd70efd6f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "POST /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5/action" status: 200 len: 32 microversion: 2.1 time: 0.497964 Aug 03 10:45:37.771221 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 93/186] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 3 10:45:37 2022] POST /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5/action => generated 32 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 10:45:37.784960 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-209c5ba2-eae2-4178-aa4f-3f8bb713a573 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:37.786114 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-209c5ba2-eae2-4178-aa4f-3f8bb713a573 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:37.796366 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-209c5ba2-eae2-4178-aa4f-3f8bb713a573 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:37.797061 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-209c5ba2-eae2-4178-aa4f-3f8bb713a573 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:37.798367 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-209c5ba2-eae2-4178-aa4f-3f8bb713a573 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:37.799027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-209c5ba2-eae2-4178-aa4f-3f8bb713a573 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:37.803927 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=87 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:45:38.171974 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-209c5ba2-eae2-4178-aa4f-3f8bb713a573 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:38.186923 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-209c5ba2-eae2-4178-aa4f-3f8bb713a573 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.407282 Aug 03 10:45:38.188169 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 94/187] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:37 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:38.615144 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1c5859b6-1afa-4b61-a694-2abe04753567 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Action: 'create', calling method: .version_select at 0x7fbd10a2e940>, body: {"keypair": {"name": "tempest-TestShelveInstance-241344085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQi3pw45A1yreM1hsordtpaY2qb7OWwR2iAb9Vnlo9t+A3xqGwwJ1J8AEKp0bUEQkP2JTHhVItBC7b/LAaJqAoJAGev4/cqaDm8s8P9VHeEq27UE7qFxNK81PPZPJYXlA=="}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:45:38.635651 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-1c5859b6-1afa-4b61-a694-2abe04753567 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Getting quotas for project 8c2e98a33cba4c08a55cda8dd6ed0730. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:45:38.647166 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-1c5859b6-1afa-4b61-a694-2abe04753567 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Getting quotas for user 7cb192800160427e9951a759dd10b228 and project 8c2e98a33cba4c08a55cda8dd6ed0730. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:45:38.691959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1c5859b6-1afa-4b61-a694-2abe04753567 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.627407 Aug 03 10:45:38.695266 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 94/188] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 3 10:45:38 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:45:39.061839 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bfc9c210-886e-4801-a993-ce3b2d72abe9 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] Calling method '.version_select at 0x7fbd107c84c0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:39.188266 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bfc9c210-886e-4801-a993-ce3b2d72abe9 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/480246fa-885a-4d1a-a368-e5d8789968dc" status: 200 len: 351 microversion: 2.1 time: 0.132870 Aug 03 10:45:39.189785 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 95/189] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 3 10:45:39 2022] GET /compute/v2.1/os-volumes/480246fa-885a-4d1a-a368-e5d8789968dc => generated 351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:45:39.210319 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e9bd7fe3-c9f2-41b4-8b5b-1b0257aab38b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:39.211081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e9bd7fe3-c9f2-41b4-8b5b-1b0257aab38b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:39.220156 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e9bd7fe3-c9f2-41b4-8b5b-1b0257aab38b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:39.220614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e9bd7fe3-c9f2-41b4-8b5b-1b0257aab38b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:39.225499 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e9bd7fe3-c9f2-41b4-8b5b-1b0257aab38b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:39.225499 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e9bd7fe3-c9f2-41b4-8b5b-1b0257aab38b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:39.642527 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e9bd7fe3-c9f2-41b4-8b5b-1b0257aab38b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:39.669182 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e9bd7fe3-c9f2-41b4-8b5b-1b0257aab38b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.462887 Aug 03 10:45:39.688492 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 95/190] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:39 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:40.717318 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-54c1a3aa-12d7-4d5b-9b1b-0b57d7c99a7b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:40.718065 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-54c1a3aa-12d7-4d5b-9b1b-0b57d7c99a7b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:40.729670 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-54c1a3aa-12d7-4d5b-9b1b-0b57d7c99a7b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:40.730178 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-54c1a3aa-12d7-4d5b-9b1b-0b57d7c99a7b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:40.732884 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-54c1a3aa-12d7-4d5b-9b1b-0b57d7c99a7b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:40.733382 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-54c1a3aa-12d7-4d5b-9b1b-0b57d7c99a7b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:41.076408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-54c1a3aa-12d7-4d5b-9b1b-0b57d7c99a7b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:41.086163 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-54c1a3aa-12d7-4d5b-9b1b-0b57d7c99a7b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.374480 Aug 03 10:45:41.095966 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 96/191] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:40 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:45:41.154640 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-775c6499-0d7b-4582-af76-bcdc9a506b23 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] Calling method '.version_select at 0x7fbd1079d820>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:41.227771 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-775c6499-0d7b-4582-af76-bcdc9a506b23 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/818488af-6222-4afc-99f3-f59af0804a43" status: 200 len: 350 microversion: 2.1 time: 0.079485 Aug 03 10:45:41.229624 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 96/192] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 3 10:45:41 2022] GET /compute/v2.1/os-volumes/818488af-6222-4afc-99f3-f59af0804a43 => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:45:41.249836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f4432362-3495-4798-ab28-24fe267cf7a5 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] Calling method '.version_select at 0x7fbd107d1b80>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:41.360981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f4432362-3495-4798-ab28-24fe267cf7a5 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.116903 Aug 03 10:45:41.361872 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 97/193] 10.222.0.47 () {58 vars in 1134 bytes} [Wed Aug 3 10:45:41 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:41.379813 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2a3d445d-f3b3-4a6d-8b60-7802a111db23 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] Calling method '.version_select at 0x7fbd10978430>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:41.480672 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2a3d445d-f3b3-4a6d-8b60-7802a111db23 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.105443 Aug 03 10:45:41.481250 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 97/194] 10.222.0.47 () {58 vars in 1149 bytes} [Wed Aug 3 10:45:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:45:41.505551 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-576e91c2-0e1f-43d8-ae28-de7ba77c7329 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] Calling method '.version_select at 0x7fbd10823ca0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:41.892216 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-576e91c2-0e1f-43d8-ae28-de7ba77c7329 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.394793 Aug 03 10:45:41.902945 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 98/195] 10.222.0.47 () {58 vars in 1134 bytes} [Wed Aug 3 10:45:41 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:45:41.913781 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3c84f5f3-770e-4290-9a68-326df183e453 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] Calling method '.version_select at 0x7fbd10978280>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:42.039716 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3c84f5f3-770e-4290-9a68-326df183e453 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.134042 Aug 03 10:45:42.040635 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 98/196] 10.222.0.47 () {58 vars in 1167 bytes} [Wed Aug 3 10:45:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:45:42.076035 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7f22425c-a883-4fc6-a820-25b33cdfa77d tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] Calling method '.version_select at 0x7fbd107e55e0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:42.139827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2915ddc5-0445-4635-9704-81eff5d16ab2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:42.140822 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2915ddc5-0445-4635-9704-81eff5d16ab2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:42.172582 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2915ddc5-0445-4635-9704-81eff5d16ab2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:42.175085 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2915ddc5-0445-4635-9704-81eff5d16ab2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:42.175935 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2915ddc5-0445-4635-9704-81eff5d16ab2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:42.176380 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2915ddc5-0445-4635-9704-81eff5d16ab2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:42.204542 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7f22425c-a883-4fc6-a820-25b33cdfa77d tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.141788 Aug 03 10:45:42.205214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 99/197] 10.222.0.47 () {58 vars in 1170 bytes} [Wed Aug 3 10:45:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:45:42.231541 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6a17fa95-e5cd-4cbd-83d6-e1d5a6cea70e tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] Calling method '.version_select at 0x7fbd107d1a60>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:42.364951 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6a17fa95-e5cd-4cbd-83d6-e1d5a6cea70e tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.145130 Aug 03 10:45:42.365565 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 100/198] 10.222.0.47 () {58 vars in 1155 bytes} [Wed Aug 3 10:45:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:42.380184 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-56ea68ae-990e-4542-95dc-ab5e8816b0e1 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] Calling method '.version_select at 0x7fbd107c80d0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:42.537372 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-56ea68ae-990e-4542-95dc-ab5e8816b0e1 tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.161282 Aug 03 10:45:42.542977 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 101/199] 10.222.0.47 () {58 vars in 1188 bytes} [Wed Aug 3 10:45:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:45:42.548523 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2915ddc5-0445-4635-9704-81eff5d16ab2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:42.557980 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2915ddc5-0445-4635-9704-81eff5d16ab2 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.425298 Aug 03 10:45:42.558791 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 99/200] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:42 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:42.569745 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0c180034-e797-40b7-8d41-bc2cd25589ba tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] Calling method '.version_select at 0x7fbd107e5dc0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:42.679632 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0c180034-e797-40b7-8d41-bc2cd25589ba tempest-VolumesTestJSON-1766983522 tempest-VolumesTestJSON-1766983522-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.123936 Aug 03 10:45:42.680416 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 102/201] 10.222.0.47 () {58 vars in 1155 bytes} [Wed Aug 3 10:45:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:43.580232 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-304194e0-d584-47c8-8adc-6eea80257910 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:43.580840 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-304194e0-d584-47c8-8adc-6eea80257910 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:43.588010 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-304194e0-d584-47c8-8adc-6eea80257910 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:43.588458 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-304194e0-d584-47c8-8adc-6eea80257910 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:43.589235 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-304194e0-d584-47c8-8adc-6eea80257910 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:43.589694 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-304194e0-d584-47c8-8adc-6eea80257910 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:43.765342 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-304194e0-d584-47c8-8adc-6eea80257910 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:43.773518 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-304194e0-d584-47c8-8adc-6eea80257910 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.197145 Aug 03 10:45:43.774253 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 100/202] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:43 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:44.795041 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9a871d39-acaa-49b2-baf9-9c0eccc28141 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:44.795653 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9a871d39-acaa-49b2-baf9-9c0eccc28141 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:44.801855 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9a871d39-acaa-49b2-baf9-9c0eccc28141 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:44.802293 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9a871d39-acaa-49b2-baf9-9c0eccc28141 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:44.803059 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9a871d39-acaa-49b2-baf9-9c0eccc28141 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:44.803698 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9a871d39-acaa-49b2-baf9-9c0eccc28141 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:44.957190 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9a871d39-acaa-49b2-baf9-9c0eccc28141 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:44.965122 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9a871d39-acaa-49b2-baf9-9c0eccc28141 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.173970 Aug 03 10:45:44.965739 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 103/203] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:44 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:45.986762 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-41407bea-bfb3-4141-a713-f9ad3367ff05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:45.987901 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-41407bea-bfb3-4141-a713-f9ad3367ff05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:45.994771 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-41407bea-bfb3-4141-a713-f9ad3367ff05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:45.995221 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-41407bea-bfb3-4141-a713-f9ad3367ff05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:45.995989 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-41407bea-bfb3-4141-a713-f9ad3367ff05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:45.996422 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-41407bea-bfb3-4141-a713-f9ad3367ff05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:45.999232 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:45:46.140195 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-41407bea-bfb3-4141-a713-f9ad3367ff05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:46.148026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-41407bea-bfb3-4141-a713-f9ad3367ff05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.165411 Aug 03 10:45:46.148587 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 101/204] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:45 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:47.171613 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-98b81072-8e59-4cb3-a07e-e173deae21e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:47.173400 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-98b81072-8e59-4cb3-a07e-e173deae21e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:47.183043 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-98b81072-8e59-4cb3-a07e-e173deae21e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:47.183923 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-98b81072-8e59-4cb3-a07e-e173deae21e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:47.184893 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-98b81072-8e59-4cb3-a07e-e173deae21e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:47.185420 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-98b81072-8e59-4cb3-a07e-e173deae21e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:47.360309 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-98b81072-8e59-4cb3-a07e-e173deae21e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:47.386896 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-98b81072-8e59-4cb3-a07e-e173deae21e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.221262 Aug 03 10:45:47.387622 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 104/205] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:47 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:47.680149 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-063f6462-069c-4552-a805-3f6b7101a3a9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:47.681758 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-063f6462-069c-4552-a805-3f6b7101a3a9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:47.692562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-063f6462-069c-4552-a805-3f6b7101a3a9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:47.695129 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-063f6462-069c-4552-a805-3f6b7101a3a9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:47.695129 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-063f6462-069c-4552-a805-3f6b7101a3a9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:47.695129 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-063f6462-069c-4552-a805-3f6b7101a3a9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:47.734764 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-063f6462-069c-4552-a805-3f6b7101a3a9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/ips" status: 200 len: 149 microversion: 2.1 time: 0.061762 Aug 03 10:45:47.735363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 102/206] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 3 10:45:47 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/ips => generated 149 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:45:48.408326 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ff35ccfa-c233-47dc-a8d9-4e029865da81 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:48.409055 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ff35ccfa-c233-47dc-a8d9-4e029865da81 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:48.416013 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ff35ccfa-c233-47dc-a8d9-4e029865da81 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:48.416461 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ff35ccfa-c233-47dc-a8d9-4e029865da81 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:48.417216 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ff35ccfa-c233-47dc-a8d9-4e029865da81 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:48.417695 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ff35ccfa-c233-47dc-a8d9-4e029865da81 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:48.562362 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ff35ccfa-c233-47dc-a8d9-4e029865da81 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:48.571034 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ff35ccfa-c233-47dc-a8d9-4e029865da81 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.166752 Aug 03 10:45:48.571750 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 105/207] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:48 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:49.202930 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a86e5539-0938-400d-a7f5-843407a39fa7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "739d4b15-2893-4360-9016-6c8263230878"}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:45:49.205390 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-a86e5539-0938-400d-a7f5-843407a39fa7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:49.207464 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=4 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:45:49.221513 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a86e5539-0938-400d-a7f5-843407a39fa7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:49.222371 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a86e5539-0938-400d-a7f5-843407a39fa7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:49.223173 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a86e5539-0938-400d-a7f5-843407a39fa7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:49.223773 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a86e5539-0938-400d-a7f5-843407a39fa7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:49.572761 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-a86e5539-0938-400d-a7f5-843407a39fa7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "POST /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.376445 Aug 03 10:45:49.573817 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 103/208] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 3 10:45:49 2022] POST /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:45:49.603176 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-837507da-e17a-42d8-8933-fa6726dff719 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:49.605603 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-837507da-e17a-42d8-8933-fa6726dff719 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:49.613888 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-837507da-e17a-42d8-8933-fa6726dff719 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:49.614391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-837507da-e17a-42d8-8933-fa6726dff719 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:49.615188 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-837507da-e17a-42d8-8933-fa6726dff719 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:49.615621 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-837507da-e17a-42d8-8933-fa6726dff719 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:49.868978 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-837507da-e17a-42d8-8933-fa6726dff719 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:49.881412 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-837507da-e17a-42d8-8933-fa6726dff719 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.288867 Aug 03 10:45:49.882402 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 106/209] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:49 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:50.908753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e94f3905-4410-431c-bad2-7e333d7ca852 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:50.909794 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e94f3905-4410-431c-bad2-7e333d7ca852 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:50.915927 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e94f3905-4410-431c-bad2-7e333d7ca852 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:50.916370 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e94f3905-4410-431c-bad2-7e333d7ca852 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:50.917132 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e94f3905-4410-431c-bad2-7e333d7ca852 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:50.917626 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e94f3905-4410-431c-bad2-7e333d7ca852 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:51.091411 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e94f3905-4410-431c-bad2-7e333d7ca852 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:51.099643 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e94f3905-4410-431c-bad2-7e333d7ca852 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.198969 Aug 03 10:45:51.100138 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 104/210] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:50 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:51.804007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d29ec477-e378-4184-ba1c-93f61033776a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:51.806016 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d29ec477-e378-4184-ba1c-93f61033776a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:51.824451 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d29ec477-e378-4184-ba1c-93f61033776a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:51.824926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d29ec477-e378-4184-ba1c-93f61033776a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:51.825773 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d29ec477-e378-4184-ba1c-93f61033776a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:51.826188 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d29ec477-e378-4184-ba1c-93f61033776a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:51.853980 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d29ec477-e378-4184-ba1c-93f61033776a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/ips" status: 200 len: 146 microversion: 2.1 time: 0.057430 Aug 03 10:45:51.854715 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 107/211] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 3 10:45:51 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/ips => generated 146 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:45:52.123782 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4800b32c-85de-4ba4-bbb4-50df8c57dba3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:52.124347 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4800b32c-85de-4ba4-bbb4-50df8c57dba3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:52.132689 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4800b32c-85de-4ba4-bbb4-50df8c57dba3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:52.133065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4800b32c-85de-4ba4-bbb4-50df8c57dba3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:52.134876 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4800b32c-85de-4ba4-bbb4-50df8c57dba3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:52.135375 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4800b32c-85de-4ba4-bbb4-50df8c57dba3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:52.279562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4800b32c-85de-4ba4-bbb4-50df8c57dba3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:52.288443 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-4800b32c-85de-4ba4-bbb4-50df8c57dba3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.168531 Aug 03 10:45:52.289388 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 105/212] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:52 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:53.310774 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-80fc6c96-69d6-4b09-bd54-58adf49d9321 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:53.312888 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-80fc6c96-69d6-4b09-bd54-58adf49d9321 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:53.326749 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=24 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:45:53.329030 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-80fc6c96-69d6-4b09-bd54-58adf49d9321 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:53.329501 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-80fc6c96-69d6-4b09-bd54-58adf49d9321 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:53.330273 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-80fc6c96-69d6-4b09-bd54-58adf49d9321 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:53.330701 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-80fc6c96-69d6-4b09-bd54-58adf49d9321 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:53.505942 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-80fc6c96-69d6-4b09-bd54-58adf49d9321 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:53.517446 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-80fc6c96-69d6-4b09-bd54-58adf49d9321 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.211193 Aug 03 10:45:53.518072 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 108/213] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:53 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:54.539453 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-590707cd-04b1-4faf-ba0d-e37a992cc9ce tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:54.540083 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-590707cd-04b1-4faf-ba0d-e37a992cc9ce tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:54.542728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:45:54.550314 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-590707cd-04b1-4faf-ba0d-e37a992cc9ce tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:54.550540 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-590707cd-04b1-4faf-ba0d-e37a992cc9ce tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:54.551323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-590707cd-04b1-4faf-ba0d-e37a992cc9ce tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:54.551776 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-590707cd-04b1-4faf-ba0d-e37a992cc9ce tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:54.719599 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-590707cd-04b1-4faf-ba0d-e37a992cc9ce tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:54.728190 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-590707cd-04b1-4faf-ba0d-e37a992cc9ce tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.192798 Aug 03 10:45:54.728750 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 106/214] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:54 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:45:55.753070 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-19366191-31e6-44f3-8b60-a2f467f50116 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:55.754359 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-19366191-31e6-44f3-8b60-a2f467f50116 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:55.761190 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19366191-31e6-44f3-8b60-a2f467f50116 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:55.761786 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19366191-31e6-44f3-8b60-a2f467f50116 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:55.762578 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19366191-31e6-44f3-8b60-a2f467f50116 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:55.763025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19366191-31e6-44f3-8b60-a2f467f50116 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:55.798077 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-8819360e-dcb3-4073-a85f-c5f0abbfae6f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:55.802250 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-8819360e-dcb3-4073-a85f-c5f0abbfae6f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:55.810212 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8819360e-dcb3-4073-a85f-c5f0abbfae6f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:55.810666 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8819360e-dcb3-4073-a85f-c5f0abbfae6f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:55.811662 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8819360e-dcb3-4073-a85f-c5f0abbfae6f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:55.812095 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8819360e-dcb3-4073-a85f-c5f0abbfae6f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:55.840891 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-8819360e-dcb3-4073-a85f-c5f0abbfae6f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/ips" status: 200 len: 152 microversion: 2.20 time: 0.050859 Aug 03 10:45:55.842111 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 107/215] 10.222.0.47 () {60 vars in 1289 bytes} [Wed Aug 3 10:45:55 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/ips => generated 152 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:45:55.935205 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2cb0b5e5-ad65-4c1b-9adc-258347176cc9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c746fdc9-251b-43e4-8dfa-420c4a3273aa"}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:45:55.938284 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2cb0b5e5-ad65-4c1b-9adc-258347176cc9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:55.941642 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-19366191-31e6-44f3-8b60-a2f467f50116 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:55.945560 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2cb0b5e5-ad65-4c1b-9adc-258347176cc9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:55.946284 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2cb0b5e5-ad65-4c1b-9adc-258347176cc9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:55.947127 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2cb0b5e5-ad65-4c1b-9adc-258347176cc9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:55.947573 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2cb0b5e5-ad65-4c1b-9adc-258347176cc9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:55.950982 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-19366191-31e6-44f3-8b60-a2f467f50116 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.202750 Aug 03 10:45:55.965397 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 109/216] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:55 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:56.509189 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2cb0b5e5-ad65-4c1b-9adc-258347176cc9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "POST /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.577888 Aug 03 10:45:56.509964 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 108/217] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 3 10:45:55 2022] POST /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/os-volume_attachments => generated 194 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:45:56.972334 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-516b3cb3-2d52-4af1-8aa5-cd99ac2a8b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:56.972937 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-516b3cb3-2d52-4af1-8aa5-cd99ac2a8b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:56.979103 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-516b3cb3-2d52-4af1-8aa5-cd99ac2a8b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:56.979546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-516b3cb3-2d52-4af1-8aa5-cd99ac2a8b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:56.980310 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-516b3cb3-2d52-4af1-8aa5-cd99ac2a8b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:56.980740 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-516b3cb3-2d52-4af1-8aa5-cd99ac2a8b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:57.124319 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-516b3cb3-2d52-4af1-8aa5-cd99ac2a8b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:57.132573 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-516b3cb3-2d52-4af1-8aa5-cd99ac2a8b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.164141 Aug 03 10:45:57.133152 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 110/218] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:56 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:45:57.294210 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-8e1b8a98-ad85-4d42-a41a-464be3ba4967 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Action: 'create', calling method: .version_select at 0x7fbd108e4ee0>, body: {"keypair": {"name": "tempest-keypair-432022352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAn3X3OIbo23X/8ciZH05Z/wjs9JJKsm+sCzfX3vnp0RNAZjusfeBAFtLc0cu0RmbiSECPrPAEkDSuHV4ClMGcra0ONPP4jEOD+hD9chdc5BT94I5QuwsEoEDAYeTTxcHw=="}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:45:57.322033 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-8e1b8a98-ad85-4d42-a41a-464be3ba4967 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for project 40540f8322a54133bc32e1af000810ad. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:45:57.326938 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-8e1b8a98-ad85-4d42-a41a-464be3ba4967 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for user 956aff831fa04d29ba5cffb88e73f4d2 and project 40540f8322a54133bc32e1af000810ad. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:45:57.352646 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-8e1b8a98-ad85-4d42-a41a-464be3ba4967 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064626 Aug 03 10:45:57.359992 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 109/219] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 3 10:45:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:45:58.156034 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-319880d6-b3f5-4e42-99d4-732e4b85d393 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:45:58.156775 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-319880d6-b3f5-4e42-99d4-732e4b85d393 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:58.163528 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-319880d6-b3f5-4e42-99d4-732e4b85d393 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:58.164075 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-319880d6-b3f5-4e42-99d4-732e4b85d393 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:58.165141 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-319880d6-b3f5-4e42-99d4-732e4b85d393 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:58.165773 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-319880d6-b3f5-4e42-99d4-732e4b85d393 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:58.424385 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-319880d6-b3f5-4e42-99d4-732e4b85d393 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:45:58.437629 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-319880d6-b3f5-4e42-99d4-732e4b85d393 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.286359 Aug 03 10:45:58.438315 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 111/220] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:45:58 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:45:58.578530 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9abbf57e-dabd-4623-a3d1-ede341609bf3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:45:58.579514 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9abbf57e-dabd-4623-a3d1-ede341609bf3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:45:58.762377 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9abbf57e-dabd-4623-a3d1-ede341609bf3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:58.763175 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9abbf57e-dabd-4623-a3d1-ede341609bf3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:58.764306 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9abbf57e-dabd-4623-a3d1-ede341609bf3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:45:58.765089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9abbf57e-dabd-4623-a3d1-ede341609bf3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:45:58.803249 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-9abbf57e-dabd-4623-a3d1-ede341609bf3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lazy-loading 'flavor' on Instance uuid 5895a291-434d-4b7c-85cd-0264cf37f5f3 {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:45:58.899954 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1958208415", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42fc3d27-55c9-4201-9ee3-9a52a8c6af61"}], "security_groups": [{"name": "tempest-securitygroup--1736374857"}], "key_name": "tempest-keypair-432022352", "user_data": "}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:00.962047 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9abbf57e-dabd-4623-a3d1-ede341609bf3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "POST /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/action" status: 202 len: 0 microversion: 2.20 time: 2.390617 Aug 03 10:46:00.965813 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 110/221] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Aug 3 10:45:58 2022] POST /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/action => generated 0 bytes in 2392 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:46:00.969344 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-eed0e94c-1f9c-4b17-9e9a-ae96921a4d1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:00.970105 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-eed0e94c-1f9c-4b17-9e9a-ae96921a4d1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:00.979786 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-eed0e94c-1f9c-4b17-9e9a-ae96921a4d1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:00.980606 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-eed0e94c-1f9c-4b17-9e9a-ae96921a4d1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:00.981796 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-eed0e94c-1f9c-4b17-9e9a-ae96921a4d1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:00.982630 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-eed0e94c-1f9c-4b17-9e9a-ae96921a4d1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:01.051401 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] validate_networks() for [('42fc3d27-55c9-4201-9ee3-9a52a8c6af61', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:46:01.254533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-eed0e94c-1f9c-4b17-9e9a-ae96921a4d1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:01.267842 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-eed0e94c-1f9c-4b17-9e9a-ae96921a4d1f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.303414 Aug 03 10:46:01.269431 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 111/222] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:00 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:01.276853 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3a1d4ad9-6a86-4d99-b098-ab3690823042 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:01.277984 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3a1d4ad9-6a86-4d99-b098-ab3690823042 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:01.295673 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3a1d4ad9-6a86-4d99-b098-ab3690823042 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:01.296648 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3a1d4ad9-6a86-4d99-b098-ab3690823042 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:01.297890 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3a1d4ad9-6a86-4d99-b098-ab3690823042 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:01.298876 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3a1d4ad9-6a86-4d99-b098-ab3690823042 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:01.540991 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3a1d4ad9-6a86-4d99-b098-ab3690823042 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:01.573827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3a1d4ad9-6a86-4d99-b098-ab3690823042 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:01.573827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3a1d4ad9-6a86-4d99-b098-ab3690823042 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:01.574556 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3a1d4ad9-6a86-4d99-b098-ab3690823042 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.303643 Aug 03 10:46:01.589494 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 112/223] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:01 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:01.708769 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:46:01.709567 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:46:01.710399 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:46:01.711119 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:46:01.711877 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:46:01.726795 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:01.727610 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:01.729063 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:01.729883 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:01.760226 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for project 40540f8322a54133bc32e1af000810ad. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:46:01.765491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for user 956aff831fa04d29ba5cffb88e73f4d2 and project 40540f8322a54133bc32e1af000810ad. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:46:01.777536 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:46:01.779846 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:46:01.836121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c55fc18c-7e5e-4471-bce2-a610fc357c2e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.940603 Aug 03 10:46:01.836771 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 112/224] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:45:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:46:01.848426 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-f8bd42f8-c9ef-4624-8a9d-7afcc7122627 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:01.849033 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-f8bd42f8-c9ef-4624-8a9d-7afcc7122627 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:01.955107 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f8bd42f8-c9ef-4624-8a9d-7afcc7122627 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:01.962442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-f8bd42f8-c9ef-4624-8a9d-7afcc7122627 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1241 microversion: 2.1 time: 0.118575 Aug 03 10:46:01.964042 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 113/225] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:01 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1241 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:02.292726 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-af5cf64a-ac33-4c9a-afdc-c4e3c3ea497f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:02.293593 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-af5cf64a-ac33-4c9a-afdc-c4e3c3ea497f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:02.301768 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-af5cf64a-ac33-4c9a-afdc-c4e3c3ea497f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:02.302434 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-af5cf64a-ac33-4c9a-afdc-c4e3c3ea497f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:02.303399 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-af5cf64a-ac33-4c9a-afdc-c4e3c3ea497f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:02.304006 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-af5cf64a-ac33-4c9a-afdc-c4e3c3ea497f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:02.470448 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-af5cf64a-ac33-4c9a-afdc-c4e3c3ea497f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:02.479605 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-af5cf64a-ac33-4c9a-afdc-c4e3c3ea497f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.191755 Aug 03 10:46:02.480426 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 113/226] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:02 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:02.600621 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-90fa27c5-d486-4f2a-8792-faa87978bbd9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:02.601643 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-90fa27c5-d486-4f2a-8792-faa87978bbd9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:02.611098 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-90fa27c5-d486-4f2a-8792-faa87978bbd9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:02.612095 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-90fa27c5-d486-4f2a-8792-faa87978bbd9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:02.613706 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-90fa27c5-d486-4f2a-8792-faa87978bbd9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:02.614541 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-90fa27c5-d486-4f2a-8792-faa87978bbd9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:02.778982 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-90fa27c5-d486-4f2a-8792-faa87978bbd9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:02.788030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-90fa27c5-d486-4f2a-8792-faa87978bbd9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:02.789638 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-90fa27c5-d486-4f2a-8792-faa87978bbd9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:02.790806 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-90fa27c5-d486-4f2a-8792-faa87978bbd9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.196689 Aug 03 10:46:02.791367 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 114/227] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:02 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:02.984531 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6bb639d4-e929-4464-b11a-3ea0cd5091bd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:02.985143 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6bb639d4-e929-4464-b11a-3ea0cd5091bd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:02.994487 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6bb639d4-e929-4464-b11a-3ea0cd5091bd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:02.994938 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6bb639d4-e929-4464-b11a-3ea0cd5091bd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:02.996815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6bb639d4-e929-4464-b11a-3ea0cd5091bd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:02.997266 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6bb639d4-e929-4464-b11a-3ea0cd5091bd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:03.080405 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6bb639d4-e929-4464-b11a-3ea0cd5091bd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:03.088811 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6bb639d4-e929-4464-b11a-3ea0cd5091bd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1237 microversion: 2.1 time: 0.108529 Aug 03 10:46:03.089404 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 114/228] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:02 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1237 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:03.501383 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-f8f5b723-539a-4ba6-bccf-59da5724a26c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:03.502054 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-f8f5b723-539a-4ba6-bccf-59da5724a26c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:03.511325 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f8f5b723-539a-4ba6-bccf-59da5724a26c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:03.511778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f8f5b723-539a-4ba6-bccf-59da5724a26c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:03.512555 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f8f5b723-539a-4ba6-bccf-59da5724a26c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:03.512987 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f8f5b723-539a-4ba6-bccf-59da5724a26c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:03.672894 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f8f5b723-539a-4ba6-bccf-59da5724a26c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:03.677127 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:03.692487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-f8f5b723-539a-4ba6-bccf-59da5724a26c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.194820 Aug 03 10:46:03.693194 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 115/229] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:03 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:03.816699 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2a70a11b-c6fc-452c-ab2b-5708557a23f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:03.817593 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2a70a11b-c6fc-452c-ab2b-5708557a23f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:03.830877 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a70a11b-c6fc-452c-ab2b-5708557a23f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:03.832511 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a70a11b-c6fc-452c-ab2b-5708557a23f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:03.834115 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a70a11b-c6fc-452c-ab2b-5708557a23f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:03.835077 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a70a11b-c6fc-452c-ab2b-5708557a23f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:04.027255 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2a70a11b-c6fc-452c-ab2b-5708557a23f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:04.063074 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2a70a11b-c6fc-452c-ab2b-5708557a23f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:04.065991 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2a70a11b-c6fc-452c-ab2b-5708557a23f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:04.067647 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2a70a11b-c6fc-452c-ab2b-5708557a23f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.256120 Aug 03 10:46:04.068425 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 115/230] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:03 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:04.110943 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-8ce4793c-1739-48d3-9ac7-bb26f6abdab2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:04.111785 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-8ce4793c-1739-48d3-9ac7-bb26f6abdab2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:04.127663 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8ce4793c-1739-48d3-9ac7-bb26f6abdab2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:04.130059 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8ce4793c-1739-48d3-9ac7-bb26f6abdab2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:04.131601 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8ce4793c-1739-48d3-9ac7-bb26f6abdab2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:04.136354 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8ce4793c-1739-48d3-9ac7-bb26f6abdab2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:04.255385 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-65feb686-a897-4f60-ba4d-d250b7296607 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:04.259762 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-8ce4793c-1739-48d3-9ac7-bb26f6abdab2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:04.269326 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-65feb686-a897-4f60-ba4d-d250b7296607 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:04.269824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-65feb686-a897-4f60-ba4d-d250b7296607 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:04.271264 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-8ce4793c-1739-48d3-9ac7-bb26f6abdab2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1299 microversion: 2.1 time: 0.165123 Aug 03 10:46:04.286472 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 116/231] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:04 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1299 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:04.355795 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-65feb686-a897-4f60-ba4d-d250b7296607 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Going to try to stop instance {{(pid=124388) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 10:46:04.404757 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-65feb686-a897-4f60-ba4d-d250b7296607 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "POST /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/action" status: 202 len: 0 microversion: 2.1 time: 0.154504 Aug 03 10:46:04.404757 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 116/232] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 3 10:46:04 2022] POST /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:46:04.415849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4aaa43b8-9299-4545-87ba-5ee1182beba5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:04.416727 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4aaa43b8-9299-4545-87ba-5ee1182beba5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:04.427667 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4aaa43b8-9299-4545-87ba-5ee1182beba5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:04.428613 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4aaa43b8-9299-4545-87ba-5ee1182beba5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:04.429714 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4aaa43b8-9299-4545-87ba-5ee1182beba5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:04.430224 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4aaa43b8-9299-4545-87ba-5ee1182beba5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:04.594541 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4aaa43b8-9299-4545-87ba-5ee1182beba5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:04.604051 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-4aaa43b8-9299-4545-87ba-5ee1182beba5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1724 microversion: 2.1 time: 0.194629 Aug 03 10:46:04.604804 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 117/233] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:04 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:04.727122 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7e62938c-d8e7-40ab-abf7-8613b8dd6993 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:04.727740 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7e62938c-d8e7-40ab-abf7-8613b8dd6993 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:04.736357 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7e62938c-d8e7-40ab-abf7-8613b8dd6993 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:04.736903 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7e62938c-d8e7-40ab-abf7-8613b8dd6993 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:04.738372 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7e62938c-d8e7-40ab-abf7-8613b8dd6993 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:04.738953 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7e62938c-d8e7-40ab-abf7-8613b8dd6993 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:04.909957 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7e62938c-d8e7-40ab-abf7-8613b8dd6993 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:04.915062 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:04.932105 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7e62938c-d8e7-40ab-abf7-8613b8dd6993 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.209155 Aug 03 10:46:04.933458 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 117/234] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:04 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:05.092680 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-192342f5-e6c7-4e68-b9a3-ab68b00a2114 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:05.093382 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-192342f5-e6c7-4e68-b9a3-ab68b00a2114 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:05.101448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-192342f5-e6c7-4e68-b9a3-ab68b00a2114 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:05.102090 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-192342f5-e6c7-4e68-b9a3-ab68b00a2114 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:05.102973 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-192342f5-e6c7-4e68-b9a3-ab68b00a2114 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:05.103599 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-192342f5-e6c7-4e68-b9a3-ab68b00a2114 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:05.284128 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-192342f5-e6c7-4e68-b9a3-ab68b00a2114 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:05.296544 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-192342f5-e6c7-4e68-b9a3-ab68b00a2114 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:05.298981 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-192342f5-e6c7-4e68-b9a3-ab68b00a2114 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:05.300308 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-192342f5-e6c7-4e68-b9a3-ab68b00a2114 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.211824 Aug 03 10:46:05.301208 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f1aacca6-7b38-40ed-a8e1-44354200e4a3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:05.301589 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 118/235] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:05 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:05.301845 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f1aacca6-7b38-40ed-a8e1-44354200e4a3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:05.309567 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f1aacca6-7b38-40ed-a8e1-44354200e4a3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:05.310131 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f1aacca6-7b38-40ed-a8e1-44354200e4a3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:05.311306 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f1aacca6-7b38-40ed-a8e1-44354200e4a3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:05.312059 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f1aacca6-7b38-40ed-a8e1-44354200e4a3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:05.627784 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e7d361f4-2067-4e42-9962-c31546ed51eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:05.628577 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e7d361f4-2067-4e42-9962-c31546ed51eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:05.634940 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e7d361f4-2067-4e42-9962-c31546ed51eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:05.635560 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e7d361f4-2067-4e42-9962-c31546ed51eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:05.636598 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e7d361f4-2067-4e42-9962-c31546ed51eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:05.637132 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e7d361f4-2067-4e42-9962-c31546ed51eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:05.659719 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f1aacca6-7b38-40ed-a8e1-44354200e4a3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:05.669690 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f1aacca6-7b38-40ed-a8e1-44354200e4a3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1367 microversion: 2.1 time: 0.378248 Aug 03 10:46:05.670979 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 118/236] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:05 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:05.681273 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-bef9ffd5-b05e-431a-b783-a4aef7b8e455 req-42f8b4b3-4929-49c3-bc72-1347fa97cf8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d121b133-039a-4f9c-9caa-299cc961d570", "tag": "107092f8-4e20-4d57-9423-1448baab2b16"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:05.694264 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-bef9ffd5-b05e-431a-b783-a4aef7b8e455 req-42f8b4b3-4929-49c3-bc72-1347fa97cf8b service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:05.694949 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-bef9ffd5-b05e-431a-b783-a4aef7b8e455 req-42f8b4b3-4929-49c3-bc72-1347fa97cf8b service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:05.706349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-bef9ffd5-b05e-431a-b783-a4aef7b8e455 req-42f8b4b3-4929-49c3-bc72-1347fa97cf8b service nova] Creating event network-changed:107092f8-4e20-4d57-9423-1448baab2b16 for instance d121b133-039a-4f9c-9caa-299cc961d570 on hv-cinder-85083 Aug 03 10:46:05.711721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-bef9ffd5-b05e-431a-b783-a4aef7b8e455 req-42f8b4b3-4929-49c3-bc72-1347fa97cf8b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034654 Aug 03 10:46:05.712507 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 119/237] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:46:05.780577 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e7d361f4-2067-4e42-9962-c31546ed51eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:05.789329 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e7d361f4-2067-4e42-9962-c31546ed51eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1724 microversion: 2.1 time: 0.166134 Aug 03 10:46:05.790049 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 119/238] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:05 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:05.955094 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0845b37d-c3d6-4628-90b6-7d0040078f46 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:05.955823 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0845b37d-c3d6-4628-90b6-7d0040078f46 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:05.962222 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0845b37d-c3d6-4628-90b6-7d0040078f46 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:05.962663 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0845b37d-c3d6-4628-90b6-7d0040078f46 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:05.963452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0845b37d-c3d6-4628-90b6-7d0040078f46 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:05.963867 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0845b37d-c3d6-4628-90b6-7d0040078f46 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:06.105824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0845b37d-c3d6-4628-90b6-7d0040078f46 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:06.114196 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0845b37d-c3d6-4628-90b6-7d0040078f46 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.163349 Aug 03 10:46:06.114769 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 120/239] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:05 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:06.325710 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d25fb5ce-1213-40d8-b17f-f4490cfb2e68 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:06.326321 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d25fb5ce-1213-40d8-b17f-f4490cfb2e68 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:06.333602 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d25fb5ce-1213-40d8-b17f-f4490cfb2e68 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:06.334053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d25fb5ce-1213-40d8-b17f-f4490cfb2e68 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:06.334930 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d25fb5ce-1213-40d8-b17f-f4490cfb2e68 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:06.335365 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d25fb5ce-1213-40d8-b17f-f4490cfb2e68 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:06.480325 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d25fb5ce-1213-40d8-b17f-f4490cfb2e68 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:06.488936 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d25fb5ce-1213-40d8-b17f-f4490cfb2e68 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:06.490501 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d25fb5ce-1213-40d8-b17f-f4490cfb2e68 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:06.491684 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d25fb5ce-1213-40d8-b17f-f4490cfb2e68 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.170120 Aug 03 10:46:06.492241 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 120/240] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:06 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:06.692243 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cf3ac4bf-e365-4c99-ab2c-206523f0027a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:06.692857 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-cf3ac4bf-e365-4c99-ab2c-206523f0027a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:06.699276 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cf3ac4bf-e365-4c99-ab2c-206523f0027a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:06.699720 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cf3ac4bf-e365-4c99-ab2c-206523f0027a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:06.700493 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cf3ac4bf-e365-4c99-ab2c-206523f0027a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:06.700927 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cf3ac4bf-e365-4c99-ab2c-206523f0027a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:06.811483 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-cd892f89-b654-4574-91ea-ea52f29b533a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:06.812163 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-cd892f89-b654-4574-91ea-ea52f29b533a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:06.818700 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cd892f89-b654-4574-91ea-ea52f29b533a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:06.819278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cd892f89-b654-4574-91ea-ea52f29b533a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:06.820734 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cd892f89-b654-4574-91ea-ea52f29b533a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:06.821234 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cd892f89-b654-4574-91ea-ea52f29b533a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:06.843170 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-cf3ac4bf-e365-4c99-ab2c-206523f0027a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:06.853816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-cf3ac4bf-e365-4c99-ab2c-206523f0027a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1367 microversion: 2.1 time: 0.166024 Aug 03 10:46:06.854950 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 121/241] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:06 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:06.961419 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-cd892f89-b654-4574-91ea-ea52f29b533a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:06.969412 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-cd892f89-b654-4574-91ea-ea52f29b533a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1724 microversion: 2.1 time: 0.162359 Aug 03 10:46:06.970001 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 121/242] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:06 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:07.136062 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-99ab1086-1b7e-4158-820f-ef71f5be0924 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:07.136676 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-99ab1086-1b7e-4158-820f-ef71f5be0924 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:07.142810 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-99ab1086-1b7e-4158-820f-ef71f5be0924 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:07.143264 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-99ab1086-1b7e-4158-820f-ef71f5be0924 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:07.144601 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-99ab1086-1b7e-4158-820f-ef71f5be0924 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:07.145036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-99ab1086-1b7e-4158-820f-ef71f5be0924 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:07.301381 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-99ab1086-1b7e-4158-820f-ef71f5be0924 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:07.304160 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-99ab1086-1b7e-4158-820f-ef71f5be0924 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.172070 Aug 03 10:46:07.305231 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 122/243] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:07 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:07.515051 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-64a62f9a-7629-4323-8253-aa68c669a36b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:07.515905 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-64a62f9a-7629-4323-8253-aa68c669a36b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:07.523658 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-64a62f9a-7629-4323-8253-aa68c669a36b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:07.529563 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-64a62f9a-7629-4323-8253-aa68c669a36b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:07.530712 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-64a62f9a-7629-4323-8253-aa68c669a36b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:07.531316 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-64a62f9a-7629-4323-8253-aa68c669a36b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:07.700977 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-64a62f9a-7629-4323-8253-aa68c669a36b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:07.709814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-64a62f9a-7629-4323-8253-aa68c669a36b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:07.712322 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-64a62f9a-7629-4323-8253-aa68c669a36b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:07.713586 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-64a62f9a-7629-4323-8253-aa68c669a36b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.202345 Aug 03 10:46:07.714292 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 122/244] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:07 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:07.875637 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8bd1f9aa-7f6e-4955-937f-ddf063f14c57 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:07.876324 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8bd1f9aa-7f6e-4955-937f-ddf063f14c57 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:07.882617 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8bd1f9aa-7f6e-4955-937f-ddf063f14c57 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:07.883174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8bd1f9aa-7f6e-4955-937f-ddf063f14c57 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:07.884023 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8bd1f9aa-7f6e-4955-937f-ddf063f14c57 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:07.884523 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8bd1f9aa-7f6e-4955-937f-ddf063f14c57 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:07.994500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-74306876-bd24-422e-bf15-4cf3d8ab972b tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:07.995149 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-74306876-bd24-422e-bf15-4cf3d8ab972b tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:08.004152 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-74306876-bd24-422e-bf15-4cf3d8ab972b tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:08.005064 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-74306876-bd24-422e-bf15-4cf3d8ab972b tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:08.005956 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-74306876-bd24-422e-bf15-4cf3d8ab972b tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:08.006406 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-74306876-bd24-422e-bf15-4cf3d8ab972b tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:08.220425 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-74306876-bd24-422e-bf15-4cf3d8ab972b tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:08.229319 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-74306876-bd24-422e-bf15-4cf3d8ab972b tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1724 microversion: 2.1 time: 0.239431 Aug 03 10:46:08.234670 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 123/245] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:07 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:08.246488 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8bd1f9aa-7f6e-4955-937f-ddf063f14c57 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:08.255622 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8bd1f9aa-7f6e-4955-937f-ddf063f14c57 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1367 microversion: 2.1 time: 0.383771 Aug 03 10:46:08.256238 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 123/246] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:07 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:08.328343 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d0128a50-e9a0-472f-ba8c-f24309d400a6 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:08.329112 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d0128a50-e9a0-472f-ba8c-f24309d400a6 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:08.336204 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d0128a50-e9a0-472f-ba8c-f24309d400a6 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:08.336915 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d0128a50-e9a0-472f-ba8c-f24309d400a6 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:08.337818 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d0128a50-e9a0-472f-ba8c-f24309d400a6 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:08.338470 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d0128a50-e9a0-472f-ba8c-f24309d400a6 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:08.481204 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d0128a50-e9a0-472f-ba8c-f24309d400a6 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:08.489520 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d0128a50-e9a0-472f-ba8c-f24309d400a6 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.165283 Aug 03 10:46:08.490095 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 124/247] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:08 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:08.737303 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e1d2b9ae-7301-4f43-adf1-afaf4df22bc1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:08.737954 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e1d2b9ae-7301-4f43-adf1-afaf4df22bc1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:08.744141 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e1d2b9ae-7301-4f43-adf1-afaf4df22bc1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:08.744534 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e1d2b9ae-7301-4f43-adf1-afaf4df22bc1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:08.745321 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e1d2b9ae-7301-4f43-adf1-afaf4df22bc1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:08.745782 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e1d2b9ae-7301-4f43-adf1-afaf4df22bc1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:08.890713 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e1d2b9ae-7301-4f43-adf1-afaf4df22bc1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:08.901031 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e1d2b9ae-7301-4f43-adf1-afaf4df22bc1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:08.902739 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e1d2b9ae-7301-4f43-adf1-afaf4df22bc1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:08.903960 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e1d2b9ae-7301-4f43-adf1-afaf4df22bc1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.170864 Aug 03 10:46:08.904657 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 124/248] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:08 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:09.252492 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-8b337e7f-d4ef-4216-9de3-1679ab8cf20e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:09.253889 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-8b337e7f-d4ef-4216-9de3-1679ab8cf20e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:09.261657 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8b337e7f-d4ef-4216-9de3-1679ab8cf20e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:09.262104 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8b337e7f-d4ef-4216-9de3-1679ab8cf20e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:09.262926 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8b337e7f-d4ef-4216-9de3-1679ab8cf20e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:09.263355 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8b337e7f-d4ef-4216-9de3-1679ab8cf20e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:09.279762 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e3a67347-d06f-4481-bb45-c5d117e73124 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:09.281111 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e3a67347-d06f-4481-bb45-c5d117e73124 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:09.287360 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3a67347-d06f-4481-bb45-c5d117e73124 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:09.287822 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3a67347-d06f-4481-bb45-c5d117e73124 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:09.288577 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3a67347-d06f-4481-bb45-c5d117e73124 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:09.289006 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3a67347-d06f-4481-bb45-c5d117e73124 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:09.467451 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-8b337e7f-d4ef-4216-9de3-1679ab8cf20e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:09.474880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e3a67347-d06f-4481-bb45-c5d117e73124 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:09.487811 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-8b337e7f-d4ef-4216-9de3-1679ab8cf20e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1724 microversion: 2.1 time: 0.239415 Aug 03 10:46:09.488393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 125/249] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:09 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:09.488763 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e3a67347-d06f-4481-bb45-c5d117e73124 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1367 microversion: 2.1 time: 0.210358 Aug 03 10:46:09.502527 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 125/250] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:09 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:09.510333 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-af0e82a2-591c-48af-a2fb-9ef935a66b34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:09.510942 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-af0e82a2-591c-48af-a2fb-9ef935a66b34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:09.516895 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-af0e82a2-591c-48af-a2fb-9ef935a66b34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:09.517278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-af0e82a2-591c-48af-a2fb-9ef935a66b34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:09.518079 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-af0e82a2-591c-48af-a2fb-9ef935a66b34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:09.518516 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-af0e82a2-591c-48af-a2fb-9ef935a66b34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:09.667848 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-af0e82a2-591c-48af-a2fb-9ef935a66b34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:09.675391 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-af0e82a2-591c-48af-a2fb-9ef935a66b34 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.168830 Aug 03 10:46:09.676026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 126/251] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:09 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:09.932039 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2935dbf9-34f3-4463-9cd6-3beeef25ed90 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:09.932666 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2935dbf9-34f3-4463-9cd6-3beeef25ed90 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:09.939852 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2935dbf9-34f3-4463-9cd6-3beeef25ed90 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:09.941200 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2935dbf9-34f3-4463-9cd6-3beeef25ed90 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:09.942431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2935dbf9-34f3-4463-9cd6-3beeef25ed90 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:09.942998 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2935dbf9-34f3-4463-9cd6-3beeef25ed90 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:10.085981 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1476356860", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-241344085", "security_groups": [{"name": "tempest-secgroup-smoke-1357056187"}], "networks": [{"uuid": "c7503be5-aa3d-47d2-9abd-57e92616e8c2"}], "block_device_mapping_v2": [{"uuid": "1fab5c58-9eac-4e0e-b6b4-3b47ffd5a88b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:10.108725 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2935dbf9-34f3-4463-9cd6-3beeef25ed90 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:10.121982 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2935dbf9-34f3-4463-9cd6-3beeef25ed90 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:10.124431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2935dbf9-34f3-4463-9cd6-3beeef25ed90 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:10.125697 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2935dbf9-34f3-4463-9cd6-3beeef25ed90 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.202214 Aug 03 10:46:10.126470 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 126/252] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:09 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:10.249495 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.network.neutron [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] validate_networks() for [('c7503be5-aa3d-47d2-9abd-57e92616e8c2', None, None, None, None, None)] {{(pid=124389) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:46:10.510306 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7218b332-bc38-459f-bb90-2338ae7ef8f8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:10.510790 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7218b332-bc38-459f-bb90-2338ae7ef8f8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:10.518177 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7218b332-bc38-459f-bb90-2338ae7ef8f8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:10.518897 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7218b332-bc38-459f-bb90-2338ae7ef8f8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:10.519800 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7218b332-bc38-459f-bb90-2338ae7ef8f8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:10.520380 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7218b332-bc38-459f-bb90-2338ae7ef8f8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:10.762045 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7218b332-bc38-459f-bb90-2338ae7ef8f8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:10.771599 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7218b332-bc38-459f-bb90-2338ae7ef8f8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1724 microversion: 2.1 time: 0.265387 Aug 03 10:46:10.772563 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 127/253] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:10 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:10.793830 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2aaeb9c6-4ae1-4727-8874-7edc38b58074 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:10.794579 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2aaeb9c6-4ae1-4727-8874-7edc38b58074 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:10.795783 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Flavor limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:46:10.796237 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Image limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:46:10.796674 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Flavor pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:46:10.797082 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Image pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:46:10.797818 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:46:10.810765 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:10.811498 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:10.812371 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:10.813027 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:10.820054 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2aaeb9c6-4ae1-4727-8874-7edc38b58074 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:10.822817 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2aaeb9c6-4ae1-4727-8874-7edc38b58074 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:10.824034 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2aaeb9c6-4ae1-4727-8874-7edc38b58074 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:10.824350 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2aaeb9c6-4ae1-4727-8874-7edc38b58074 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:10.832964 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Getting quotas for project 8c2e98a33cba4c08a55cda8dd6ed0730. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:46:10.838139 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Getting quotas for user 7cb192800160427e9951a759dd10b228 and project 8c2e98a33cba4c08a55cda8dd6ed0730. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:46:10.910739 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Going to run 1 instances... {{(pid=124389) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:46:10.913517 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1fab5c58-9eac-4e0e-b6b4-3b47ffd5a88b',volume_size=None,volume_type=None)] {{(pid=124389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:46:11.035441 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2aaeb9c6-4ae1-4727-8874-7edc38b58074 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:11.046459 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2aaeb9c6-4ae1-4727-8874-7edc38b58074 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1367 microversion: 2.1 time: 0.263340 Aug 03 10:46:11.046969 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 128/254] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:10 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:11.054615 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-350c1e9e-ec88-492e-8c0c-ac26cd3d2b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:11.055566 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-350c1e9e-ec88-492e-8c0c-ac26cd3d2b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:11.063039 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-350c1e9e-ec88-492e-8c0c-ac26cd3d2b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:11.063723 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-350c1e9e-ec88-492e-8c0c-ac26cd3d2b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:11.064674 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-350c1e9e-ec88-492e-8c0c-ac26cd3d2b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:11.065312 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-350c1e9e-ec88-492e-8c0c-ac26cd3d2b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:11.117044 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-4039b878-3021-4cc7-9b01-b845169a72ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.035734 Aug 03 10:46:11.118117 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 127/255] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:46:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 10:46:11.132825 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ecc5cf2b-bcbc-454b-8fb9-e49f0881e1de tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:11.134082 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-ecc5cf2b-bcbc-454b-8fb9-e49f0881e1de tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:11.311193 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-ecc5cf2b-bcbc-454b-8fb9-e49f0881e1de tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:11.326932 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ecc5cf2b-bcbc-454b-8fb9-e49f0881e1de tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1088 microversion: 2.1 time: 0.200412 Aug 03 10:46:11.329160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 128/256] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:11 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1088 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:11.340800 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4f036cc8-1708-4a8d-aefe-a45092dd4e98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:11.341422 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4f036cc8-1708-4a8d-aefe-a45092dd4e98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:11.346077 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-350c1e9e-ec88-492e-8c0c-ac26cd3d2b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:11.356286 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-350c1e9e-ec88-492e-8c0c-ac26cd3d2b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1502 microversion: 2.1 time: 0.307970 Aug 03 10:46:11.357427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 129/257] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:11 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1502 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:11.359631 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4f036cc8-1708-4a8d-aefe-a45092dd4e98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:11.360177 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4f036cc8-1708-4a8d-aefe-a45092dd4e98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:11.361016 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4f036cc8-1708-4a8d-aefe-a45092dd4e98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:11.361459 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4f036cc8-1708-4a8d-aefe-a45092dd4e98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:11.390435 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-417b9ef2-2ca6-4311-bb77-d35d4efb7033 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6022a5ee-74e1-44b5-b654-10a639ce596b"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:11.395467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-417b9ef2-2ca6-4311-bb77-d35d4efb7033 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:11.404837 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-417b9ef2-2ca6-4311-bb77-d35d4efb7033 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:11.405893 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-417b9ef2-2ca6-4311-bb77-d35d4efb7033 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:11.407016 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-417b9ef2-2ca6-4311-bb77-d35d4efb7033 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:11.407600 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-417b9ef2-2ca6-4311-bb77-d35d4efb7033 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:11.449372 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-417b9ef2-2ca6-4311-bb77-d35d4efb7033 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] HTTP exception thrown: Cannot 'attach_volume' instance da275cd5-e209-45c5-a46e-3082d668a6b5 while it is in vm_state rescued Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-417b9ef2-2ca6-4311-bb77-d35d4efb7033 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Request method failure captured: Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: POST /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5/os-volume_attachments HTTP/1.1 Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 74 Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lF2pOWmhCbmjifspfqKpHzAxIhbE2uFuR1reDQeN7S2zka5yP-6of9k_LGD6SROhSzwAA7evRUOk4uaXIt5tYTAzEQECkaYCrzI0Aqtaz-VJZl5OF72sMI3bRVG5PZbcMDIsDqI_MOs7HwjGb9gR7eJuQbd-puQcPhNc0yJtZc7Oks Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: ca8789771e8a4505866424b6c7748291 Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168500966 Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:46:11.451481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:46:11.453019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca8789771e8a4505866424b6c7748291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca8789771e8a4505866424b6c7748291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca8789771e8a4505866424b6c7748291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca8789771e8a4505866424b6c7748291", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:46:11.453019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168500966 Aug 03 10:46:11.453019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: ca8789771e8a4505866424b6c7748291 Aug 03 10:46:11.453019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168500966 Aug 03 10:46:11.453019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-ServerRescueNegativeTestJSON-168500966-project Aug 03 10:46:11.453019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:46:11.453019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:46:11.453019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: a5e714aad25f4fda8acf767ad7e2490b Aug 03 10:46:11.453019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168500966-project Aug 03 10:46:11.453019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Aug 03 10:46:11.453019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {"volumeAttachment": {"volumeId": "6022a5ee-74e1-44b5-b654-10a639ce596b"}} Aug 03 10:46:11.453019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Cannot 'attach_volume' instance da275cd5-e209-45c5-a46e-3082d668a6b5 while it is in vm_state rescued Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'server_id': 'da275cd5-e209-45c5-a46e-3082d668a6b5', 'body': {'volumeAttachment': {'volumeId': '6022a5ee-74e1-44b5-b654-10a639ce596b'}}} Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance da275cd5-e209-45c5-a46e-3082d668a6b5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:46:11.453886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance da275cd5-e209-45c5-a46e-3082d668a6b5 while it is in vm_state rescued Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:46:11.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:46:11.457011 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:46:11.457011 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:46:11.457011 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance da275cd5-e209-45c5-a46e-3082d668a6b5 while it is in vm_state rescued Aug 03 10:46:11.457011 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:46:11.458750 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-417b9ef2-2ca6-4311-bb77-d35d4efb7033 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Returning 409 to user: Cannot 'attach_volume' instance da275cd5-e209-45c5-a46e-3082d668a6b5 while it is in vm_state rescued {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:46:11.460105 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-417b9ef2-2ca6-4311-bb77-d35d4efb7033 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "POST /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.077170 Aug 03 10:46:11.461792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 130/258] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 3 10:46:11 2022] POST /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5/os-volume_attachments => generated 152 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 10:46:11.473685 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-764ab866-b1ce-4e1d-ae54-d62232ea9b25 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:11.474834 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-764ab866-b1ce-4e1d-ae54-d62232ea9b25 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:11.483802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-764ab866-b1ce-4e1d-ae54-d62232ea9b25 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:11.484723 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-764ab866-b1ce-4e1d-ae54-d62232ea9b25 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:11.485837 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-764ab866-b1ce-4e1d-ae54-d62232ea9b25 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:11.486623 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-764ab866-b1ce-4e1d-ae54-d62232ea9b25 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:11.618024 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-764ab866-b1ce-4e1d-ae54-d62232ea9b25 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "POST /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5/action" status: 202 len: 0 microversion: 2.1 time: 0.150783 Aug 03 10:46:11.619073 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 131/259] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 3 10:46:11 2022] POST /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:46:11.648969 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bae377e9-d6c4-4afe-b6f3-a6e0501f8a55 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:11.656382 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bae377e9-d6c4-4afe-b6f3-a6e0501f8a55 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:11.664723 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bae377e9-d6c4-4afe-b6f3-a6e0501f8a55 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:11.665563 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bae377e9-d6c4-4afe-b6f3-a6e0501f8a55 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:11.666582 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bae377e9-d6c4-4afe-b6f3-a6e0501f8a55 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:11.668391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bae377e9-d6c4-4afe-b6f3-a6e0501f8a55 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:11.744721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:11.772773 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=6 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:11.790352 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4f036cc8-1708-4a8d-aefe-a45092dd4e98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:11.804203 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4f036cc8-1708-4a8d-aefe-a45092dd4e98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:11.809874 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4f036cc8-1708-4a8d-aefe-a45092dd4e98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:11.812971 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-4f036cc8-1708-4a8d-aefe-a45092dd4e98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.481907 Aug 03 10:46:11.818721 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 129/260] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:11 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:11.831938 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d6893ef0-3b93-47dc-b50f-2ebd8d252f0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:11.832946 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d6893ef0-3b93-47dc-b50f-2ebd8d252f0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:11.849732 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d6893ef0-3b93-47dc-b50f-2ebd8d252f0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:11.853811 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d6893ef0-3b93-47dc-b50f-2ebd8d252f0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:11.858521 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d6893ef0-3b93-47dc-b50f-2ebd8d252f0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:11.860841 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d6893ef0-3b93-47dc-b50f-2ebd8d252f0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:11.875663 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bae377e9-d6c4-4afe-b6f3-a6e0501f8a55 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:11.885037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bae377e9-d6c4-4afe-b6f3-a6e0501f8a55 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1510 microversion: 2.1 time: 0.242790 Aug 03 10:46:11.886133 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 132/261] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:11 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:12.076065 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7c0f0c88-1c1a-4d7c-8c07-b9186c3b3336 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:12.078489 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7c0f0c88-1c1a-4d7c-8c07-b9186c3b3336 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:12.084555 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d6893ef0-3b93-47dc-b50f-2ebd8d252f0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:12.085867 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7c0f0c88-1c1a-4d7c-8c07-b9186c3b3336 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:12.086993 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7c0f0c88-1c1a-4d7c-8c07-b9186c3b3336 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:12.088012 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7c0f0c88-1c1a-4d7c-8c07-b9186c3b3336 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:12.088667 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7c0f0c88-1c1a-4d7c-8c07-b9186c3b3336 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:12.094521 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d6893ef0-3b93-47dc-b50f-2ebd8d252f0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1724 microversion: 2.1 time: 0.274261 Aug 03 10:46:12.095186 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 130/262] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:11 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:12.315570 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7c0f0c88-1c1a-4d7c-8c07-b9186c3b3336 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:12.324397 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7c0f0c88-1c1a-4d7c-8c07-b9186c3b3336 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1367 microversion: 2.1 time: 0.254894 Aug 03 10:46:12.325229 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 133/263] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:12 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:12.355575 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-bb00f61d-795f-4f19-84c7-132d2780cc3a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:12.356194 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-bb00f61d-795f-4f19-84c7-132d2780cc3a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:12.363638 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bb00f61d-795f-4f19-84c7-132d2780cc3a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:12.364089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bb00f61d-795f-4f19-84c7-132d2780cc3a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:12.365044 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bb00f61d-795f-4f19-84c7-132d2780cc3a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:12.365510 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bb00f61d-795f-4f19-84c7-132d2780cc3a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:12.437547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-bb00f61d-795f-4f19-84c7-132d2780cc3a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:12.443703 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-bb00f61d-795f-4f19-84c7-132d2780cc3a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1186 microversion: 2.1 time: 0.092459 Aug 03 10:46:12.444437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 131/264] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:12 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1186 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:12.848674 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-805cf4ea-0688-4c57-a646-6714a03bb21a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:12.850384 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-805cf4ea-0688-4c57-a646-6714a03bb21a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:12.866874 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-805cf4ea-0688-4c57-a646-6714a03bb21a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:12.867327 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-805cf4ea-0688-4c57-a646-6714a03bb21a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:12.868324 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-805cf4ea-0688-4c57-a646-6714a03bb21a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:12.868961 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-805cf4ea-0688-4c57-a646-6714a03bb21a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:12.894445 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:12.907065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-fef4a3d1-46e8-4199-85fd-e9d07132719b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:12.908316 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-fef4a3d1-46e8-4199-85fd-e9d07132719b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:12.916925 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fef4a3d1-46e8-4199-85fd-e9d07132719b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:12.917380 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fef4a3d1-46e8-4199-85fd-e9d07132719b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:12.918206 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fef4a3d1-46e8-4199-85fd-e9d07132719b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:12.918650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fef4a3d1-46e8-4199-85fd-e9d07132719b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:13.141582 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-805cf4ea-0688-4c57-a646-6714a03bb21a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:13.150999 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-805cf4ea-0688-4c57-a646-6714a03bb21a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:13.152984 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-805cf4ea-0688-4c57-a646-6714a03bb21a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:13.154440 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-805cf4ea-0688-4c57-a646-6714a03bb21a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.310114 Aug 03 10:46:13.155014 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 134/265] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:12 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:13.160398 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3b1df93d-4209-42e3-ae4a-892e09907b3d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:13.161081 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3b1df93d-4209-42e3-ae4a-892e09907b3d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:13.167846 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b1df93d-4209-42e3-ae4a-892e09907b3d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:13.168318 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b1df93d-4209-42e3-ae4a-892e09907b3d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:13.169440 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b1df93d-4209-42e3-ae4a-892e09907b3d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:13.170136 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b1df93d-4209-42e3-ae4a-892e09907b3d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:13.186896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fef4a3d1-46e8-4199-85fd-e9d07132719b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:13.200134 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-fef4a3d1-46e8-4199-85fd-e9d07132719b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1510 microversion: 2.1 time: 0.296796 Aug 03 10:46:13.200967 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 132/266] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:12 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1510 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:13.347588 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9ef3fb50-14c2-445c-a51a-d9047f68eb54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:13.348453 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9ef3fb50-14c2-445c-a51a-d9047f68eb54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:13.356571 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9ef3fb50-14c2-445c-a51a-d9047f68eb54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:13.357199 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9ef3fb50-14c2-445c-a51a-d9047f68eb54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:13.358207 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9ef3fb50-14c2-445c-a51a-d9047f68eb54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:13.358780 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9ef3fb50-14c2-445c-a51a-d9047f68eb54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:13.382158 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3b1df93d-4209-42e3-ae4a-892e09907b3d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:13.392181 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3b1df93d-4209-42e3-ae4a-892e09907b3d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1724 microversion: 2.1 time: 0.235851 Aug 03 10:46:13.392874 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 135/267] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:13 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:13.467165 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0e7adf2b-6ddb-4496-9392-2308a262f95a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:13.468227 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0e7adf2b-6ddb-4496-9392-2308a262f95a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:13.475315 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0e7adf2b-6ddb-4496-9392-2308a262f95a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:13.475759 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0e7adf2b-6ddb-4496-9392-2308a262f95a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:13.476554 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0e7adf2b-6ddb-4496-9392-2308a262f95a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:13.476988 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0e7adf2b-6ddb-4496-9392-2308a262f95a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:13.509390 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9ef3fb50-14c2-445c-a51a-d9047f68eb54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:13.518082 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9ef3fb50-14c2-445c-a51a-d9047f68eb54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1367 microversion: 2.1 time: 0.176001 Aug 03 10:46:13.519285 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 133/268] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:13 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:13.544723 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0e7adf2b-6ddb-4496-9392-2308a262f95a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:13.553306 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0e7adf2b-6ddb-4496-9392-2308a262f95a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1204 microversion: 2.1 time: 0.091889 Aug 03 10:46:13.553940 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 136/269] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:13 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1204 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:14.179772 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-cbaa1f74-585c-4379-b6cd-bf0036f0b857 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:14.181204 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-cbaa1f74-585c-4379-b6cd-bf0036f0b857 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:14.190214 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cbaa1f74-585c-4379-b6cd-bf0036f0b857 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:14.190593 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cbaa1f74-585c-4379-b6cd-bf0036f0b857 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:14.191375 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cbaa1f74-585c-4379-b6cd-bf0036f0b857 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:14.191813 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cbaa1f74-585c-4379-b6cd-bf0036f0b857 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:14.196447 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=100 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:14.206746 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-84376adb-8f45-4716-8bb9-734af685e0ea req-1f2184d4-2115-45f6-a71e-1d96b1bc518b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d121b133-039a-4f9c-9caa-299cc961d570", "name": "network-vif-plugged", "status": "completed", "tag": "107092f8-4e20-4d57-9423-1448baab2b16"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:14.225536 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-84376adb-8f45-4716-8bb9-734af685e0ea req-1f2184d4-2115-45f6-a71e-1d96b1bc518b service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:14.226081 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-84376adb-8f45-4716-8bb9-734af685e0ea req-1f2184d4-2115-45f6-a71e-1d96b1bc518b service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:14.240558 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-84376adb-8f45-4716-8bb9-734af685e0ea req-1f2184d4-2115-45f6-a71e-1d96b1bc518b service nova] Creating event network-vif-plugged:107092f8-4e20-4d57-9423-1448baab2b16 for instance d121b133-039a-4f9c-9caa-299cc961d570 on hv-cinder-85083 Aug 03 10:46:14.246909 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-84376adb-8f45-4716-8bb9-734af685e0ea req-1f2184d4-2115-45f6-a71e-1d96b1bc518b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044510 Aug 03 10:46:14.247614 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 137/270] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:46:14.254184 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c15128ad-4c81-4352-8069-34094c5019cf tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:14.255213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c15128ad-4c81-4352-8069-34094c5019cf tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:14.264822 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c15128ad-4c81-4352-8069-34094c5019cf tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:14.269177 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c15128ad-4c81-4352-8069-34094c5019cf tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:14.269325 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c15128ad-4c81-4352-8069-34094c5019cf tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:14.269766 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c15128ad-4c81-4352-8069-34094c5019cf tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:14.425660 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-cbaa1f74-585c-4379-b6cd-bf0036f0b857 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:14.434729 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-cbaa1f74-585c-4379-b6cd-bf0036f0b857 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:14.436762 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-cbaa1f74-585c-4379-b6cd-bf0036f0b857 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:14.438663 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-cbaa1f74-585c-4379-b6cd-bf0036f0b857 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.263701 Aug 03 10:46:14.439256 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 134/271] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:14 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:14.444424 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-26007e47-0914-4a1b-a6fa-28b2d0162729 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:14.446053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-26007e47-0914-4a1b-a6fa-28b2d0162729 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:14.452262 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-26007e47-0914-4a1b-a6fa-28b2d0162729 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:14.452906 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-26007e47-0914-4a1b-a6fa-28b2d0162729 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:14.454396 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-26007e47-0914-4a1b-a6fa-28b2d0162729 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:14.454396 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-26007e47-0914-4a1b-a6fa-28b2d0162729 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:14.478396 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c15128ad-4c81-4352-8069-34094c5019cf tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:14.488616 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c15128ad-4c81-4352-8069-34094c5019cf tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1510 microversion: 2.1 time: 0.239501 Aug 03 10:46:14.489419 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 138/272] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:14 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1510 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:14.541279 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-357392bf-0910-4b71-a47e-77f28cea3e58 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:14.541917 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-357392bf-0910-4b71-a47e-77f28cea3e58 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:14.549432 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-357392bf-0910-4b71-a47e-77f28cea3e58 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:14.550688 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-357392bf-0910-4b71-a47e-77f28cea3e58 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:14.552177 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-357392bf-0910-4b71-a47e-77f28cea3e58 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:14.552621 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-357392bf-0910-4b71-a47e-77f28cea3e58 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:14.681759 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-26007e47-0914-4a1b-a6fa-28b2d0162729 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:14.690791 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-26007e47-0914-4a1b-a6fa-28b2d0162729 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1724 microversion: 2.1 time: 0.249791 Aug 03 10:46:14.691440 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 135/273] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:14 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:14.696050 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-105ae1a4-068e-42a8-8a3c-87ed4161ac8b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:14.696661 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-105ae1a4-068e-42a8-8a3c-87ed4161ac8b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:14.702754 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-105ae1a4-068e-42a8-8a3c-87ed4161ac8b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:14.703202 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-105ae1a4-068e-42a8-8a3c-87ed4161ac8b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:14.703970 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-105ae1a4-068e-42a8-8a3c-87ed4161ac8b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:14.704386 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-105ae1a4-068e-42a8-8a3c-87ed4161ac8b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:14.787310 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-357392bf-0910-4b71-a47e-77f28cea3e58 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:14.789314 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-105ae1a4-068e-42a8-8a3c-87ed4161ac8b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:14.795297 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-357392bf-0910-4b71-a47e-77f28cea3e58 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1367 microversion: 2.1 time: 0.258226 Aug 03 10:46:14.795969 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 139/274] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:14 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:14.796997 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-105ae1a4-068e-42a8-8a3c-87ed4161ac8b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1204 microversion: 2.1 time: 0.104541 Aug 03 10:46:14.797586 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 136/275] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:14 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1204 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:15.470812 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b1622451-205f-4f43-afc7-d5e437dacc9a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:15.471353 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b1622451-205f-4f43-afc7-d5e437dacc9a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:15.477538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b1622451-205f-4f43-afc7-d5e437dacc9a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:15.477984 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b1622451-205f-4f43-afc7-d5e437dacc9a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:15.478745 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b1622451-205f-4f43-afc7-d5e437dacc9a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:15.479176 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b1622451-205f-4f43-afc7-d5e437dacc9a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:15.510454 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-fb39e9ca-a910-4c31-a8be-6993242b6f08 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:15.511067 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-fb39e9ca-a910-4c31-a8be-6993242b6f08 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:15.517885 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fb39e9ca-a910-4c31-a8be-6993242b6f08 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:15.518399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fb39e9ca-a910-4c31-a8be-6993242b6f08 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:15.519710 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fb39e9ca-a910-4c31-a8be-6993242b6f08 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:15.520144 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fb39e9ca-a910-4c31-a8be-6993242b6f08 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:15.671497 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b1622451-205f-4f43-afc7-d5e437dacc9a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:15.680443 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b1622451-205f-4f43-afc7-d5e437dacc9a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:15.683899 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b1622451-205f-4f43-afc7-d5e437dacc9a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:15.685152 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b1622451-205f-4f43-afc7-d5e437dacc9a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.218287 Aug 03 10:46:15.700634 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 140/276] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:15 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:15.703260 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fb39e9ca-a910-4c31-a8be-6993242b6f08 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:15.712639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-fb39e9ca-a910-4c31-a8be-6993242b6f08 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1510 microversion: 2.1 time: 0.206025 Aug 03 10:46:15.713034 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-46500062-8cc8-4d6c-a89a-ff9a228bd17c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:15.713543 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 137/277] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:15 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1510 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:15.713819 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-46500062-8cc8-4d6c-a89a-ff9a228bd17c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:15.720442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-46500062-8cc8-4d6c-a89a-ff9a228bd17c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:15.720944 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-46500062-8cc8-4d6c-a89a-ff9a228bd17c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:15.721709 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-46500062-8cc8-4d6c-a89a-ff9a228bd17c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:15.722147 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-46500062-8cc8-4d6c-a89a-ff9a228bd17c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:15.816682 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-21b30fa3-d8bd-4195-bf7f-2ffe4e1a2fde tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:15.817291 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-21b30fa3-d8bd-4195-bf7f-2ffe4e1a2fde tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:15.823811 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-21b30fa3-d8bd-4195-bf7f-2ffe4e1a2fde tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:15.824260 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-21b30fa3-d8bd-4195-bf7f-2ffe4e1a2fde tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:15.825039 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-21b30fa3-d8bd-4195-bf7f-2ffe4e1a2fde tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:15.825484 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-21b30fa3-d8bd-4195-bf7f-2ffe4e1a2fde tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:15.880387 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-46500062-8cc8-4d6c-a89a-ff9a228bd17c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:15.889015 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-46500062-8cc8-4d6c-a89a-ff9a228bd17c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1724 microversion: 2.1 time: 0.180248 Aug 03 10:46:15.889594 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 141/278] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:15 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:15.894177 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-56c9fa29-c928-4e22-b533-28097a362260 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:15.894777 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-56c9fa29-c928-4e22-b533-28097a362260 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:15.900599 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-56c9fa29-c928-4e22-b533-28097a362260 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:15.901241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-56c9fa29-c928-4e22-b533-28097a362260 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:15.902211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-56c9fa29-c928-4e22-b533-28097a362260 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:15.902796 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-56c9fa29-c928-4e22-b533-28097a362260 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:15.975561 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-56c9fa29-c928-4e22-b533-28097a362260 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:15.984091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-56c9fa29-c928-4e22-b533-28097a362260 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1204 microversion: 2.1 time: 0.093369 Aug 03 10:46:15.985585 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 142/279] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:15 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1204 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:15.999279 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-21b30fa3-d8bd-4195-bf7f-2ffe4e1a2fde tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:16.008264 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-21b30fa3-d8bd-4195-bf7f-2ffe4e1a2fde tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1367 microversion: 2.1 time: 0.195537 Aug 03 10:46:16.008839 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 138/280] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:15 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:16.708480 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ad0d775d-e2ef-4348-90ff-9c8b4fab7357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:16.709082 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ad0d775d-e2ef-4348-90ff-9c8b4fab7357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:16.715231 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ad0d775d-e2ef-4348-90ff-9c8b4fab7357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:16.715673 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ad0d775d-e2ef-4348-90ff-9c8b4fab7357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:16.716441 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ad0d775d-e2ef-4348-90ff-9c8b4fab7357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:16.716854 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ad0d775d-e2ef-4348-90ff-9c8b4fab7357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:16.741354 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ef8f148c-0145-4346-8370-699dced960cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:16.742043 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-ef8f148c-0145-4346-8370-699dced960cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:16.748156 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ef8f148c-0145-4346-8370-699dced960cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:16.748601 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ef8f148c-0145-4346-8370-699dced960cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:16.749367 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ef8f148c-0145-4346-8370-699dced960cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:16.749825 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ef8f148c-0145-4346-8370-699dced960cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:16.906491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ad0d775d-e2ef-4348-90ff-9c8b4fab7357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:16.916902 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ad0d775d-e2ef-4348-90ff-9c8b4fab7357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:16.918377 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ad0d775d-e2ef-4348-90ff-9c8b4fab7357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:16.919258 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ad0d775d-e2ef-4348-90ff-9c8b4fab7357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.214581 Aug 03 10:46:16.919669 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 143/281] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:16 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:16.924444 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-846ace50-deb4-4b77-adaf-8d512763d2a9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:16.925855 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-846ace50-deb4-4b77-adaf-8d512763d2a9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:16.932807 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-846ace50-deb4-4b77-adaf-8d512763d2a9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:16.935726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-ef8f148c-0145-4346-8370-699dced960cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:16.937747 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-846ace50-deb4-4b77-adaf-8d512763d2a9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:16.938757 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-846ace50-deb4-4b77-adaf-8d512763d2a9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:16.939332 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-846ace50-deb4-4b77-adaf-8d512763d2a9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:16.945849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ef8f148c-0145-4346-8370-699dced960cb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1510 microversion: 2.1 time: 0.208642 Aug 03 10:46:16.960039 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 139/282] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:16 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:17.008217 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b0ffe4f7-5434-41b3-92d0-c5e9b2721b28 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:17.009897 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b0ffe4f7-5434-41b3-92d0-c5e9b2721b28 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:17.017555 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b0ffe4f7-5434-41b3-92d0-c5e9b2721b28 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:17.017914 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b0ffe4f7-5434-41b3-92d0-c5e9b2721b28 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:17.020532 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b0ffe4f7-5434-41b3-92d0-c5e9b2721b28 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:17.021576 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b0ffe4f7-5434-41b3-92d0-c5e9b2721b28 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:17.121265 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b0ffe4f7-5434-41b3-92d0-c5e9b2721b28 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:17.132285 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b0ffe4f7-5434-41b3-92d0-c5e9b2721b28 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1204 microversion: 2.1 time: 0.128402 Aug 03 10:46:17.132884 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 140/283] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:17 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1204 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:17.137578 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-98fc88da-9157-42df-805a-8005d31d5696 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:17.138193 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-98fc88da-9157-42df-805a-8005d31d5696 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:17.140107 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:17.145773 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-98fc88da-9157-42df-805a-8005d31d5696 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:17.146227 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-98fc88da-9157-42df-805a-8005d31d5696 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:17.147013 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-98fc88da-9157-42df-805a-8005d31d5696 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:17.147446 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-98fc88da-9157-42df-805a-8005d31d5696 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:17.149668 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-846ace50-deb4-4b77-adaf-8d512763d2a9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:17.162085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-846ace50-deb4-4b77-adaf-8d512763d2a9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1724 microversion: 2.1 time: 0.241230 Aug 03 10:46:17.162599 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 144/284] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:16 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:17.294063 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-98fc88da-9157-42df-805a-8005d31d5696 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:17.300463 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-98fc88da-9157-42df-805a-8005d31d5696 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1367 microversion: 2.1 time: 0.165982 Aug 03 10:46:17.301067 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 141/285] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:17 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:17.944305 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d60e37a9-7f47-4c2c-a504-c48c9410016e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:17.944881 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d60e37a9-7f47-4c2c-a504-c48c9410016e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:17.951385 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d60e37a9-7f47-4c2c-a504-c48c9410016e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:17.951828 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d60e37a9-7f47-4c2c-a504-c48c9410016e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:17.952603 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d60e37a9-7f47-4c2c-a504-c48c9410016e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:17.953032 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d60e37a9-7f47-4c2c-a504-c48c9410016e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:17.968402 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-286d53cf-e763-4ba2-8ba6-da66c219a6fe tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:17.969116 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-286d53cf-e763-4ba2-8ba6-da66c219a6fe tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:17.976013 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-286d53cf-e763-4ba2-8ba6-da66c219a6fe tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:17.976459 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-286d53cf-e763-4ba2-8ba6-da66c219a6fe tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:17.977242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-286d53cf-e763-4ba2-8ba6-da66c219a6fe tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:17.977733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-286d53cf-e763-4ba2-8ba6-da66c219a6fe tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:18.165350 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d60e37a9-7f47-4c2c-a504-c48c9410016e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:18.175567 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d60e37a9-7f47-4c2c-a504-c48c9410016e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:18.177501 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d60e37a9-7f47-4c2c-a504-c48c9410016e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:18.178842 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d60e37a9-7f47-4c2c-a504-c48c9410016e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.239146 Aug 03 10:46:18.181356 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 145/286] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:17 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:18.182914 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-286d53cf-e763-4ba2-8ba6-da66c219a6fe tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:18.186826 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-47933454-d872-4942-bf95-3df6366faad1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:18.187665 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-47933454-d872-4942-bf95-3df6366faad1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:18.191581 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-286d53cf-e763-4ba2-8ba6-da66c219a6fe tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1510 microversion: 2.1 time: 0.227004 Aug 03 10:46:18.194989 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-47933454-d872-4942-bf95-3df6366faad1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:18.194989 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-47933454-d872-4942-bf95-3df6366faad1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:18.195649 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-47933454-d872-4942-bf95-3df6366faad1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:18.196079 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-47933454-d872-4942-bf95-3df6366faad1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:18.201348 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 142/287] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:17 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:18.207140 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-052c2a68-3e15-4a3c-bcd0-e5c79395a1b3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:18.207776 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-052c2a68-3e15-4a3c-bcd0-e5c79395a1b3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:18.215159 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-052c2a68-3e15-4a3c-bcd0-e5c79395a1b3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:18.215618 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-052c2a68-3e15-4a3c-bcd0-e5c79395a1b3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:18.216429 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-052c2a68-3e15-4a3c-bcd0-e5c79395a1b3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:18.216862 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-052c2a68-3e15-4a3c-bcd0-e5c79395a1b3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:18.282819 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-47933454-d872-4942-bf95-3df6366faad1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:18.291389 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-47933454-d872-4942-bf95-3df6366faad1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1204 microversion: 2.1 time: 0.108903 Aug 03 10:46:18.291986 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 146/288] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:18 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1204 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:18.329693 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7ec2d0b4-6c12-46d3-8a90-027089605dd3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:18.331594 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7ec2d0b4-6c12-46d3-8a90-027089605dd3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:18.337489 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7ec2d0b4-6c12-46d3-8a90-027089605dd3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:18.337965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7ec2d0b4-6c12-46d3-8a90-027089605dd3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:18.338738 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7ec2d0b4-6c12-46d3-8a90-027089605dd3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:18.339172 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7ec2d0b4-6c12-46d3-8a90-027089605dd3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:18.375105 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-052c2a68-3e15-4a3c-bcd0-e5c79395a1b3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:18.383772 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-052c2a68-3e15-4a3c-bcd0-e5c79395a1b3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1701 microversion: 2.1 time: 0.180987 Aug 03 10:46:18.384392 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 143/289] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:18 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1701 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:18.406311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a8193527-25c7-4108-ae71-fca4834631db tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:18.416076 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a8193527-25c7-4108-ae71-fca4834631db tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:18.416422 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a8193527-25c7-4108-ae71-fca4834631db tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:18.482081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-a8193527-25c7-4108-ae71-fca4834631db tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Going to try to start instance {{(pid=124389) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 10:46:18.483657 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7ec2d0b4-6c12-46d3-8a90-027089605dd3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:18.492192 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7ec2d0b4-6c12-46d3-8a90-027089605dd3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1367 microversion: 2.1 time: 0.166248 Aug 03 10:46:18.492772 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 147/290] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:18 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:18.532234 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-a8193527-25c7-4108-ae71-fca4834631db tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "POST /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/action" status: 202 len: 0 microversion: 2.1 time: 0.130442 Aug 03 10:46:18.532839 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 144/291] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 3 10:46:18 2022] POST /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 10:46:18.541344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5be56435-8ccb-49a2-98fd-e7c033266016 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:18.542162 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5be56435-8ccb-49a2-98fd-e7c033266016 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:18.548873 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5be56435-8ccb-49a2-98fd-e7c033266016 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:18.549321 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5be56435-8ccb-49a2-98fd-e7c033266016 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:18.550152 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5be56435-8ccb-49a2-98fd-e7c033266016 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:18.550591 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5be56435-8ccb-49a2-98fd-e7c033266016 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:18.701541 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5be56435-8ccb-49a2-98fd-e7c033266016 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:18.715760 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5be56435-8ccb-49a2-98fd-e7c033266016 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1710 microversion: 2.1 time: 0.172999 Aug 03 10:46:18.715760 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 148/292] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:18 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1710 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:19.210519 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-915bb848-e411-4753-b9aa-2ae755650beb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:19.211250 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-915bb848-e411-4753-b9aa-2ae755650beb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:19.213298 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-993ee236-010c-4a7c-b1b9-d0045cadbc36 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:19.213935 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-993ee236-010c-4a7c-b1b9-d0045cadbc36 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:19.217738 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-915bb848-e411-4753-b9aa-2ae755650beb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:19.218194 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-915bb848-e411-4753-b9aa-2ae755650beb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:19.218968 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-915bb848-e411-4753-b9aa-2ae755650beb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:19.219400 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-915bb848-e411-4753-b9aa-2ae755650beb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:19.220202 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-993ee236-010c-4a7c-b1b9-d0045cadbc36 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:19.220649 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-993ee236-010c-4a7c-b1b9-d0045cadbc36 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:19.221446 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-993ee236-010c-4a7c-b1b9-d0045cadbc36 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:19.221903 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-993ee236-010c-4a7c-b1b9-d0045cadbc36 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:19.433125 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-915bb848-e411-4753-b9aa-2ae755650beb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:19.443640 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-993ee236-010c-4a7c-b1b9-d0045cadbc36 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:19.445833 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-915bb848-e411-4753-b9aa-2ae755650beb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:19.450084 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-915bb848-e411-4753-b9aa-2ae755650beb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:19.452548 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-915bb848-e411-4753-b9aa-2ae755650beb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.247181 Aug 03 10:46:19.452644 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-993ee236-010c-4a7c-b1b9-d0045cadbc36 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1510 microversion: 2.1 time: 0.243510 Aug 03 10:46:19.453105 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 149/293] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:19 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:19.458285 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 145/294] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:19 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:19.459005 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0fd341d5-c75f-452b-8412-2baa0b1deca5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:19.459607 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0fd341d5-c75f-452b-8412-2baa0b1deca5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:19.461685 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:19.467919 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0fd341d5-c75f-452b-8412-2baa0b1deca5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:19.468366 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0fd341d5-c75f-452b-8412-2baa0b1deca5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:19.469133 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0fd341d5-c75f-452b-8412-2baa0b1deca5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:19.469598 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0fd341d5-c75f-452b-8412-2baa0b1deca5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:19.513942 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2974d038-1a42-4b85-a93c-f67e19136bcc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:19.515529 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2974d038-1a42-4b85-a93c-f67e19136bcc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:19.522366 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2974d038-1a42-4b85-a93c-f67e19136bcc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:19.522918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2974d038-1a42-4b85-a93c-f67e19136bcc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:19.523699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2974d038-1a42-4b85-a93c-f67e19136bcc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:19.524128 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2974d038-1a42-4b85-a93c-f67e19136bcc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:19.543257 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0fd341d5-c75f-452b-8412-2baa0b1deca5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:19.552135 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0fd341d5-c75f-452b-8412-2baa0b1deca5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1204 microversion: 2.1 time: 0.097590 Aug 03 10:46:19.552848 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 150/295] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:19 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1204 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:19.668196 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2974d038-1a42-4b85-a93c-f67e19136bcc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:19.676786 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2974d038-1a42-4b85-a93c-f67e19136bcc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1367 microversion: 2.1 time: 0.167102 Aug 03 10:46:19.677787 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 146/296] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:19 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:19.740432 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-47b80c90-c094-4178-8d11-73fe8d0d547e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:19.741789 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-47b80c90-c094-4178-8d11-73fe8d0d547e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:19.754818 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-47b80c90-c094-4178-8d11-73fe8d0d547e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:19.755532 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-47b80c90-c094-4178-8d11-73fe8d0d547e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:19.757246 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-47b80c90-c094-4178-8d11-73fe8d0d547e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:19.758251 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-47b80c90-c094-4178-8d11-73fe8d0d547e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:19.930885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-47b80c90-c094-4178-8d11-73fe8d0d547e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:19.933191 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:19.941948 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-47b80c90-c094-4178-8d11-73fe8d0d547e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1710 microversion: 2.1 time: 0.211164 Aug 03 10:46:19.942642 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 151/297] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:19 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1710 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:20.490464 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b094672a-c48f-4555-96ca-0428dc84d612 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:20.491707 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b094672a-c48f-4555-96ca-0428dc84d612 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:20.492565 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-24e8f478-726a-42b8-a861-555418b3b7bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:20.493179 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-24e8f478-726a-42b8-a861-555418b3b7bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:20.498512 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b094672a-c48f-4555-96ca-0428dc84d612 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:20.498959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b094672a-c48f-4555-96ca-0428dc84d612 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:20.499736 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b094672a-c48f-4555-96ca-0428dc84d612 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:20.500350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b094672a-c48f-4555-96ca-0428dc84d612 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:20.502192 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-24e8f478-726a-42b8-a861-555418b3b7bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:20.503760 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-24e8f478-726a-42b8-a861-555418b3b7bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:20.505123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-24e8f478-726a-42b8-a861-555418b3b7bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:20.505843 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-24e8f478-726a-42b8-a861-555418b3b7bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:20.747120 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b094672a-c48f-4555-96ca-0428dc84d612 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:20.748576 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-24e8f478-726a-42b8-a861-555418b3b7bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:20.760127 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-24e8f478-726a-42b8-a861-555418b3b7bb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1516 microversion: 2.1 time: 0.271227 Aug 03 10:46:20.761100 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b094672a-c48f-4555-96ca-0428dc84d612 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:20.763295 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b094672a-c48f-4555-96ca-0428dc84d612 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:20.764609 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b094672a-c48f-4555-96ca-0428dc84d612 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.278811 Aug 03 10:46:20.777837 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 152/298] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:20 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1516 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:20.778267 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 147/299] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:20 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:20.789838 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-51bf9213-9b25-4a41-903d-e1e55cc471f9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:20.790697 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-51bf9213-9b25-4a41-903d-e1e55cc471f9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:20.801257 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ead48d02-5af5-43f9-82e6-d8e8c455cf35 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:20.806217 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ead48d02-5af5-43f9-82e6-d8e8c455cf35 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:20.812799 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-51bf9213-9b25-4a41-903d-e1e55cc471f9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:20.813337 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-51bf9213-9b25-4a41-903d-e1e55cc471f9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:20.818039 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-51bf9213-9b25-4a41-903d-e1e55cc471f9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:20.818890 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-51bf9213-9b25-4a41-903d-e1e55cc471f9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:20.825820 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ead48d02-5af5-43f9-82e6-d8e8c455cf35 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:20.827200 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ead48d02-5af5-43f9-82e6-d8e8c455cf35 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:20.829324 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ead48d02-5af5-43f9-82e6-d8e8c455cf35 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:20.830032 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ead48d02-5af5-43f9-82e6-d8e8c455cf35 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:20.833209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:21.319250 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=14 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:21.351845 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-51bf9213-9b25-4a41-903d-e1e55cc471f9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:21.365132 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-51bf9213-9b25-4a41-903d-e1e55cc471f9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1367 microversion: 2.1 time: 0.581617 Aug 03 10:46:21.365797 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 148/300] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:20 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1367 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:21.379534 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-466b61fc-0a90-44ee-b079-4444e61a2ad6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:21.380461 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-466b61fc-0a90-44ee-b079-4444e61a2ad6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:21.386891 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-466b61fc-0a90-44ee-b079-4444e61a2ad6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:21.387704 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-466b61fc-0a90-44ee-b079-4444e61a2ad6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:21.388722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-466b61fc-0a90-44ee-b079-4444e61a2ad6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:21.389743 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-466b61fc-0a90-44ee-b079-4444e61a2ad6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:21.412342 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ead48d02-5af5-43f9-82e6-d8e8c455cf35 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:21.422962 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ead48d02-5af5-43f9-82e6-d8e8c455cf35 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1272 microversion: 2.1 time: 0.643525 Aug 03 10:46:21.423560 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 153/301] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:20 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1272 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:21.559704 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-466b61fc-0a90-44ee-b079-4444e61a2ad6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:21.561886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:21.569888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-466b61fc-0a90-44ee-b079-4444e61a2ad6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1710 microversion: 2.1 time: 0.194143 Aug 03 10:46:21.570491 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 149/302] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:21 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1710 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:21.791590 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-38790c64-ccd4-4da1-be70-ebc597be08aa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:21.793995 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-38790c64-ccd4-4da1-be70-ebc597be08aa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:21.800955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-38790c64-ccd4-4da1-be70-ebc597be08aa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:21.801413 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-38790c64-ccd4-4da1-be70-ebc597be08aa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:21.802426 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-38790c64-ccd4-4da1-be70-ebc597be08aa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:21.802926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-38790c64-ccd4-4da1-be70-ebc597be08aa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:21.903592 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-20c13525-259d-4045-bd2b-a092f9bbae5c req-6f348739-1d27-4984-b30e-d1cd406cc056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e1399d5-9f28-4b92-a752-a233a1652022", "tag": "ea1ca950-d067-4257-9371-6667208eda63"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:21.916586 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-20c13525-259d-4045-bd2b-a092f9bbae5c req-6f348739-1d27-4984-b30e-d1cd406cc056 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:21.917321 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-20c13525-259d-4045-bd2b-a092f9bbae5c req-6f348739-1d27-4984-b30e-d1cd406cc056 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:21.929871 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-20c13525-259d-4045-bd2b-a092f9bbae5c req-6f348739-1d27-4984-b30e-d1cd406cc056 service nova] Creating event network-changed:ea1ca950-d067-4257-9371-6667208eda63 for instance 7e1399d5-9f28-4b92-a752-a233a1652022 on hv-cinder-85083 Aug 03 10:46:21.934217 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-20c13525-259d-4045-bd2b-a092f9bbae5c req-6f348739-1d27-4984-b30e-d1cd406cc056 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035263 Aug 03 10:46:21.935424 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 150/303] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:46:21.944149 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-38790c64-ccd4-4da1-be70-ebc597be08aa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:21.952641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-38790c64-ccd4-4da1-be70-ebc597be08aa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:21.954198 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-38790c64-ccd4-4da1-be70-ebc597be08aa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:21.955389 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-38790c64-ccd4-4da1-be70-ebc597be08aa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.168223 Aug 03 10:46:21.957095 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 154/304] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:21 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:22.386410 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-0ee678ad-b862-4319-9792-0f3c5272d6ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:22.387120 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-0ee678ad-b862-4319-9792-0f3c5272d6ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:22.394061 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0ee678ad-b862-4319-9792-0f3c5272d6ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:22.394452 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0ee678ad-b862-4319-9792-0f3c5272d6ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:22.395228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0ee678ad-b862-4319-9792-0f3c5272d6ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:22.395670 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0ee678ad-b862-4319-9792-0f3c5272d6ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:22.446209 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d601f2d3-324c-4385-abf5-a59c4cd290db tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:22.446815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d601f2d3-324c-4385-abf5-a59c4cd290db tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:22.452934 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d601f2d3-324c-4385-abf5-a59c4cd290db tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:22.453372 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d601f2d3-324c-4385-abf5-a59c4cd290db tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:22.454227 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d601f2d3-324c-4385-abf5-a59c4cd290db tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:22.454656 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d601f2d3-324c-4385-abf5-a59c4cd290db tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:22.583774 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-0ee678ad-b862-4319-9792-0f3c5272d6ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:22.591910 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-0ee678ad-b862-4319-9792-0f3c5272d6ca tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1367 microversion: 2.1 time: 0.209677 Aug 03 10:46:22.592536 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 151/305] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:22 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:22.602882 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-71492721-5c96-4583-8d35-3530261bea3e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:22.603807 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-71492721-5c96-4583-8d35-3530261bea3e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:22.611422 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-71492721-5c96-4583-8d35-3530261bea3e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:22.612574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-71492721-5c96-4583-8d35-3530261bea3e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:22.613404 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-71492721-5c96-4583-8d35-3530261bea3e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:22.614050 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-71492721-5c96-4583-8d35-3530261bea3e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:22.643541 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d601f2d3-324c-4385-abf5-a59c4cd290db tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:22.656419 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d601f2d3-324c-4385-abf5-a59c4cd290db tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.213804 Aug 03 10:46:22.656956 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 155/306] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:22 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:22.768714 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-71492721-5c96-4583-8d35-3530261bea3e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:22.777247 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-71492721-5c96-4583-8d35-3530261bea3e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1710 microversion: 2.1 time: 0.183621 Aug 03 10:46:22.777872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 152/307] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:22 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1710 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:22.980289 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a5ac5c6c-6ad0-4615-8162-3c58c13db5d5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:22.980880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a5ac5c6c-6ad0-4615-8162-3c58c13db5d5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:22.987515 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a5ac5c6c-6ad0-4615-8162-3c58c13db5d5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:22.987956 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a5ac5c6c-6ad0-4615-8162-3c58c13db5d5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:22.988756 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a5ac5c6c-6ad0-4615-8162-3c58c13db5d5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:22.989186 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a5ac5c6c-6ad0-4615-8162-3c58c13db5d5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:23.119979 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a5ac5c6c-6ad0-4615-8162-3c58c13db5d5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:23.128668 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a5ac5c6c-6ad0-4615-8162-3c58c13db5d5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:23.130208 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a5ac5c6c-6ad0-4615-8162-3c58c13db5d5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:23.131381 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a5ac5c6c-6ad0-4615-8162-3c58c13db5d5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.155034 Aug 03 10:46:23.131940 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 156/308] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:22 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:23.614424 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-159cb5f8-460a-40c0-8188-24d2bef71a9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:23.614951 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-159cb5f8-460a-40c0-8188-24d2bef71a9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:23.621653 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-159cb5f8-460a-40c0-8188-24d2bef71a9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:23.622099 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-159cb5f8-460a-40c0-8188-24d2bef71a9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:23.622869 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-159cb5f8-460a-40c0-8188-24d2bef71a9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:23.623290 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-159cb5f8-460a-40c0-8188-24d2bef71a9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:23.679384 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c4529fae-d6c1-475b-9470-0d69b97e4369 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:23.680007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c4529fae-d6c1-475b-9470-0d69b97e4369 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:23.686818 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c4529fae-d6c1-475b-9470-0d69b97e4369 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:23.687282 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c4529fae-d6c1-475b-9470-0d69b97e4369 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:23.688086 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c4529fae-d6c1-475b-9470-0d69b97e4369 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:23.688814 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c4529fae-d6c1-475b-9470-0d69b97e4369 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:23.813537 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-159cb5f8-460a-40c0-8188-24d2bef71a9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:23.821386 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-159cb5f8-460a-40c0-8188-24d2bef71a9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1367 microversion: 2.1 time: 0.211666 Aug 03 10:46:23.822005 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 153/309] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:23 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:23.826633 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-96009c18-86f4-43a0-9627-95db609988f4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:23.827235 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-96009c18-86f4-43a0-9627-95db609988f4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:23.833824 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-96009c18-86f4-43a0-9627-95db609988f4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:23.834287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-96009c18-86f4-43a0-9627-95db609988f4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:23.835073 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-96009c18-86f4-43a0-9627-95db609988f4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:23.835516 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-96009c18-86f4-43a0-9627-95db609988f4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:23.864532 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c4529fae-d6c1-475b-9470-0d69b97e4369 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:23.872543 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c4529fae-d6c1-475b-9470-0d69b97e4369 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.197550 Aug 03 10:46:23.873133 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 157/310] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:23 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:23.979291 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-96009c18-86f4-43a0-9627-95db609988f4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:23.988227 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-96009c18-86f4-43a0-9627-95db609988f4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1710 microversion: 2.1 time: 0.165254 Aug 03 10:46:23.988790 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 154/311] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:23 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1710 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:24.155002 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6175b4ea-f150-4e10-bbfc-a85e37ba37b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:24.155613 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6175b4ea-f150-4e10-bbfc-a85e37ba37b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:24.162376 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6175b4ea-f150-4e10-bbfc-a85e37ba37b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:24.162826 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6175b4ea-f150-4e10-bbfc-a85e37ba37b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:24.163623 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6175b4ea-f150-4e10-bbfc-a85e37ba37b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:24.164057 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6175b4ea-f150-4e10-bbfc-a85e37ba37b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:24.299016 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6175b4ea-f150-4e10-bbfc-a85e37ba37b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:24.307519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6175b4ea-f150-4e10-bbfc-a85e37ba37b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:24.309021 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6175b4ea-f150-4e10-bbfc-a85e37ba37b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:24.310243 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6175b4ea-f150-4e10-bbfc-a85e37ba37b1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.159151 Aug 03 10:46:24.310790 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 158/312] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:24 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:24.553178 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c88e3f1a-a903-4707-b32b-961620c467b5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Action: 'create', calling method: .version_select at 0x7fbd1095b820>, body: {"keypair": {"name": "tempest-keypair-1336649481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEn45pDmWRK2ImRfeMfDevUQ9jNWyZ4hM1ONDlgiwPZ/qDZ6Baz599HCxkL8DIFAWMQMVo1suSVaSOwlveYX4Ssehg94FVdUNiThHc16yTm21JUbQIimNcFFrtX30UZ1w=="}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:24.569097 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-c88e3f1a-a903-4707-b32b-961620c467b5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Getting quotas for project ca8789771e8a4505866424b6c7748291. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:46:24.573267 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-c88e3f1a-a903-4707-b32b-961620c467b5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Getting quotas for user a5e714aad25f4fda8acf767ad7e2490b and project ca8789771e8a4505866424b6c7748291. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:46:24.597211 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c88e3f1a-a903-4707-b32b-961620c467b5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047158 Aug 03 10:46:24.597849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 155/313] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 3 10:46:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:46:24.843338 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-89166dc7-6769-459e-9bd7-61237fef69c2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:24.843905 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-89166dc7-6769-459e-9bd7-61237fef69c2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:24.850902 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-89166dc7-6769-459e-9bd7-61237fef69c2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:24.851195 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-89166dc7-6769-459e-9bd7-61237fef69c2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:24.851962 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-89166dc7-6769-459e-9bd7-61237fef69c2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:24.852390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-89166dc7-6769-459e-9bd7-61237fef69c2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:24.894980 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-8669108d-2dcb-4dfb-877a-64a0961a9deb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:24.896170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-8669108d-2dcb-4dfb-877a-64a0961a9deb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:24.934538 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8669108d-2dcb-4dfb-877a-64a0961a9deb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:24.935149 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8669108d-2dcb-4dfb-877a-64a0961a9deb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:24.936189 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8669108d-2dcb-4dfb-877a-64a0961a9deb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:24.936691 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8669108d-2dcb-4dfb-877a-64a0961a9deb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:25.104355 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-89166dc7-6769-459e-9bd7-61237fef69c2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:25.116982 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-89166dc7-6769-459e-9bd7-61237fef69c2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1557 microversion: 2.1 time: 0.277976 Aug 03 10:46:25.129763 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 159/314] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:24 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1557 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:25.130977 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-315b1566-6aa0-446d-8d00-45bf666a0d28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:25.132393 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-315b1566-6aa0-446d-8d00-45bf666a0d28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:25.140522 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-315b1566-6aa0-446d-8d00-45bf666a0d28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:25.141222 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-315b1566-6aa0-446d-8d00-45bf666a0d28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:25.143967 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-315b1566-6aa0-446d-8d00-45bf666a0d28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:25.144661 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-315b1566-6aa0-446d-8d00-45bf666a0d28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:25.155594 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-8669108d-2dcb-4dfb-877a-64a0961a9deb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:25.166680 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-8669108d-2dcb-4dfb-877a-64a0961a9deb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.277296 Aug 03 10:46:25.167767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 156/315] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:24 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:25.173501 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-66d688e6-90d1-4809-a59b-b1aef40b542c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:25.174246 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-66d688e6-90d1-4809-a59b-b1aef40b542c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:25.197552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-66d688e6-90d1-4809-a59b-b1aef40b542c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:25.203382 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-66d688e6-90d1-4809-a59b-b1aef40b542c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:25.205031 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-66d688e6-90d1-4809-a59b-b1aef40b542c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:25.207330 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-66d688e6-90d1-4809-a59b-b1aef40b542c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:25.368101 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-66d688e6-90d1-4809-a59b-b1aef40b542c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.199053 Aug 03 10:46:25.373732 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 157/316] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 3 10:46:25 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570/os-interface => generated 285 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:46:25.379917 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-fba74e02-c95d-4094-8218-cdb2e8e78ae0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:25.381861 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-fba74e02-c95d-4094-8218-cdb2e8e78ae0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:25.391416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fba74e02-c95d-4094-8218-cdb2e8e78ae0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:25.392146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fba74e02-c95d-4094-8218-cdb2e8e78ae0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:25.393284 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fba74e02-c95d-4094-8218-cdb2e8e78ae0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:25.393960 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fba74e02-c95d-4094-8218-cdb2e8e78ae0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:25.583400 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-315b1566-6aa0-446d-8d00-45bf666a0d28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:25.596996 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-315b1566-6aa0-446d-8d00-45bf666a0d28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1710 microversion: 2.1 time: 0.470150 Aug 03 10:46:25.598624 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 160/317] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:25 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1710 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:25.735865 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fba74e02-c95d-4094-8218-cdb2e8e78ae0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:25.748345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fba74e02-c95d-4094-8218-cdb2e8e78ae0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:25.750628 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fba74e02-c95d-4094-8218-cdb2e8e78ae0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:25.751851 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-fba74e02-c95d-4094-8218-cdb2e8e78ae0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1744 microversion: 2.20 time: 0.376702 Aug 03 10:46:25.752423 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 158/318] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:25 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1744 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:26.186812 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bcef41bc-45c4-4d2f-943a-244b0573f034 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:26.187672 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bcef41bc-45c4-4d2f-943a-244b0573f034 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:26.196685 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcef41bc-45c4-4d2f-943a-244b0573f034 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:26.197751 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcef41bc-45c4-4d2f-943a-244b0573f034 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:26.199739 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcef41bc-45c4-4d2f-943a-244b0573f034 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:26.202978 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcef41bc-45c4-4d2f-943a-244b0573f034 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:26.479233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bcef41bc-45c4-4d2f-943a-244b0573f034 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:26.489177 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bcef41bc-45c4-4d2f-943a-244b0573f034 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.306060 Aug 03 10:46:26.489808 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 161/319] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:26 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:26.557625 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1607920498", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "680d69ed-4b8e-41f5-b67c-6ab15f91ea47"}], "security_groups": [{"name": "tempest-securitygroup--355252953"}], "key_name": "tempest-keypair-1336649481", "user_data": "}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:26.621732 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6a37666b-f940-44af-b32f-d9c19a43ecc4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:26.622128 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6a37666b-f940-44af-b32f-d9c19a43ecc4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:26.634534 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6a37666b-f940-44af-b32f-d9c19a43ecc4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:26.635066 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6a37666b-f940-44af-b32f-d9c19a43ecc4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:26.635913 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6a37666b-f940-44af-b32f-d9c19a43ecc4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:26.636417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6a37666b-f940-44af-b32f-d9c19a43ecc4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:26.782317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.network.neutron [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] validate_networks() for [('680d69ed-4b8e-41f5-b67c-6ab15f91ea47', None, None, None, None, None)] {{(pid=124389) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:46:26.997781 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6a37666b-f940-44af-b32f-d9c19a43ecc4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:27.014262 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6a37666b-f940-44af-b32f-d9c19a43ecc4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1714 microversion: 2.1 time: 0.397528 Aug 03 10:46:27.017690 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 162/320] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:26 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1714 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:27.031371 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-700a0af7-6703-492c-86c4-b8ab084ee30c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:27.032212 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-700a0af7-6703-492c-86c4-b8ab084ee30c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:27.042282 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-700a0af7-6703-492c-86c4-b8ab084ee30c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:27.045734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-700a0af7-6703-492c-86c4-b8ab084ee30c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:27.046581 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-700a0af7-6703-492c-86c4-b8ab084ee30c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:27.047019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-700a0af7-6703-492c-86c4-b8ab084ee30c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:27.405183 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-700a0af7-6703-492c-86c4-b8ab084ee30c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:27.441610 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-700a0af7-6703-492c-86c4-b8ab084ee30c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:27.450321 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-700a0af7-6703-492c-86c4-b8ab084ee30c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:27.454508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-700a0af7-6703-492c-86c4-b8ab084ee30c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1744 microversion: 2.20 time: 0.432248 Aug 03 10:46:27.455777 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 163/321] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:27 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1744 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:27.512666 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1536b7c1-f97a-4e39-a51b-d9ce47ecc9fd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:27.513368 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1536b7c1-f97a-4e39-a51b-d9ce47ecc9fd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:27.524685 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1536b7c1-f97a-4e39-a51b-d9ce47ecc9fd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:27.528808 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1536b7c1-f97a-4e39-a51b-d9ce47ecc9fd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:27.529894 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1536b7c1-f97a-4e39-a51b-d9ce47ecc9fd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:27.532810 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1536b7c1-f97a-4e39-a51b-d9ce47ecc9fd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:27.541114 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Flavor limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:46:27.541846 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Image limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:46:27.542509 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Flavor pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:46:27.542919 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Image pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:46:27.543320 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:46:27.579416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:27.580543 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:27.583950 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:27.584931 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:27.634093 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Getting quotas for project ca8789771e8a4505866424b6c7748291. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:46:27.642838 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Getting quotas for user a5e714aad25f4fda8acf767ad7e2490b and project ca8789771e8a4505866424b6c7748291. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:46:27.671016 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Going to run 1 instances... {{(pid=124389) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:46:27.674093 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:46:27.769184 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1536b7c1-f97a-4e39-a51b-d9ce47ecc9fd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:27.773064 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b5c66e54-327e-48e3-9d13-04cd32f47deb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.222012 Aug 03 10:46:27.774762 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 159/322] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:46:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:46:27.787381 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1536b7c1-f97a-4e39-a51b-d9ce47ecc9fd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.278295 Aug 03 10:46:27.787692 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 164/323] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:27 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:27.793338 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-af87d94f-9916-45c0-a4f3-9291a7d473db tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:27.794182 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-af87d94f-9916-45c0-a4f3-9291a7d473db tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:27.796830 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-a0050871-d0c3-451c-8397-f939691bd9bd req-70bd0814-9cbb-44d0-a372-50464a4e75fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d121b133-039a-4f9c-9caa-299cc961d570", "tag": "107092f8-4e20-4d57-9423-1448baab2b16"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:27.843278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-a0050871-d0c3-451c-8397-f939691bd9bd req-70bd0814-9cbb-44d0-a372-50464a4e75fb service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:27.843914 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-a0050871-d0c3-451c-8397-f939691bd9bd req-70bd0814-9cbb-44d0-a372-50464a4e75fb service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:27.867676 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-a0050871-d0c3-451c-8397-f939691bd9bd req-70bd0814-9cbb-44d0-a372-50464a4e75fb service nova] Creating event network-changed:107092f8-4e20-4d57-9423-1448baab2b16 for instance d121b133-039a-4f9c-9caa-299cc961d570 on hv-cinder-85083 Aug 03 10:46:27.869376 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-af87d94f-9916-45c0-a4f3-9291a7d473db tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:27.881191 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-af87d94f-9916-45c0-a4f3-9291a7d473db tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1246 microversion: 2.1 time: 0.091102 Aug 03 10:46:27.881351 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 165/324] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:27 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:27.890154 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-a0050871-d0c3-451c-8397-f939691bd9bd req-70bd0814-9cbb-44d0-a372-50464a4e75fb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101351 Aug 03 10:46:27.897206 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 160/325] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:46:28.482223 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d6b6fcec-f074-42cc-8c7a-c25c7e717e4c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:28.483014 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d6b6fcec-f074-42cc-8c7a-c25c7e717e4c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:28.499967 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d6b6fcec-f074-42cc-8c7a-c25c7e717e4c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:28.500661 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d6b6fcec-f074-42cc-8c7a-c25c7e717e4c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:28.501563 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d6b6fcec-f074-42cc-8c7a-c25c7e717e4c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:28.502706 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d6b6fcec-f074-42cc-8c7a-c25c7e717e4c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:28.815137 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e89b869c-5d58-4139-90fa-4d0b5bda7d9a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:28.816504 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d6b6fcec-f074-42cc-8c7a-c25c7e717e4c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:28.819965 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e89b869c-5d58-4139-90fa-4d0b5bda7d9a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:28.835654 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e89b869c-5d58-4139-90fa-4d0b5bda7d9a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:28.836122 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e89b869c-5d58-4139-90fa-4d0b5bda7d9a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:28.836920 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e89b869c-5d58-4139-90fa-4d0b5bda7d9a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:28.837355 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e89b869c-5d58-4139-90fa-4d0b5bda7d9a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:28.840364 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d6b6fcec-f074-42cc-8c7a-c25c7e717e4c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:28.848397 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d6b6fcec-f074-42cc-8c7a-c25c7e717e4c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:28.856947 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d6b6fcec-f074-42cc-8c7a-c25c7e717e4c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1739 microversion: 2.20 time: 0.378864 Aug 03 10:46:28.862824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 166/326] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:28 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1739 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:28.904201 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7d4c1d92-ebe8-4c3c-b258-4e6bd615c88e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:28.905924 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7d4c1d92-ebe8-4c3c-b258-4e6bd615c88e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:28.916451 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d4c1d92-ebe8-4c3c-b258-4e6bd615c88e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:28.917484 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d4c1d92-ebe8-4c3c-b258-4e6bd615c88e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:28.918898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d4c1d92-ebe8-4c3c-b258-4e6bd615c88e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:28.919662 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d4c1d92-ebe8-4c3c-b258-4e6bd615c88e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:29.040486 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7d4c1d92-ebe8-4c3c-b258-4e6bd615c88e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:29.083017 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7d4c1d92-ebe8-4c3c-b258-4e6bd615c88e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1242 microversion: 2.1 time: 0.180744 Aug 03 10:46:29.084615 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 167/327] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:28 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1242 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:29.108752 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e89b869c-5d58-4139-90fa-4d0b5bda7d9a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:29.118735 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e89b869c-5d58-4139-90fa-4d0b5bda7d9a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.311262 Aug 03 10:46:29.125399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 161/328] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:28 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:29.884999 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7cc4fd81-82c6-437f-9979-eabdb4d5a6d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:29.885856 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7cc4fd81-82c6-437f-9979-eabdb4d5a6d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:29.910976 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7cc4fd81-82c6-437f-9979-eabdb4d5a6d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:29.911912 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7cc4fd81-82c6-437f-9979-eabdb4d5a6d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:29.913936 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7cc4fd81-82c6-437f-9979-eabdb4d5a6d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:29.914601 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7cc4fd81-82c6-437f-9979-eabdb4d5a6d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:30.114457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-548d57ab-16f7-4020-b226-7fc2f31214ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:30.117772 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-548d57ab-16f7-4020-b226-7fc2f31214ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:30.135372 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-548d57ab-16f7-4020-b226-7fc2f31214ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:30.140850 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-548d57ab-16f7-4020-b226-7fc2f31214ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:30.146245 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7cc4fd81-82c6-437f-9979-eabdb4d5a6d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:30.151784 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-548d57ab-16f7-4020-b226-7fc2f31214ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:30.152533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-548d57ab-16f7-4020-b226-7fc2f31214ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:30.159262 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7cc4fd81-82c6-437f-9979-eabdb4d5a6d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:30.161214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7cc4fd81-82c6-437f-9979-eabdb4d5a6d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:30.162583 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7cc4fd81-82c6-437f-9979-eabdb4d5a6d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1739 microversion: 2.20 time: 0.281437 Aug 03 10:46:30.163623 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 168/329] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:29 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:30.168789 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-145a4804-b7f8-4456-948e-f5cbfe743cbe tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:30.169592 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-145a4804-b7f8-4456-948e-f5cbfe743cbe tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:30.177046 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-145a4804-b7f8-4456-948e-f5cbfe743cbe tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:30.177696 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-145a4804-b7f8-4456-948e-f5cbfe743cbe tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:30.178604 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-145a4804-b7f8-4456-948e-f5cbfe743cbe tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:30.179163 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-145a4804-b7f8-4456-948e-f5cbfe743cbe tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:30.212035 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:30.362814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-548d57ab-16f7-4020-b226-7fc2f31214ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:30.374037 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-548d57ab-16f7-4020-b226-7fc2f31214ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1242 microversion: 2.1 time: 0.269442 Aug 03 10:46:30.375310 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 162/330] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:30 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1242 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:30.503247 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-145a4804-b7f8-4456-948e-f5cbfe743cbe tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:30.512569 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-145a4804-b7f8-4456-948e-f5cbfe743cbe tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.347535 Aug 03 10:46:30.513171 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 169/331] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:30 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:31.193886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-7f73fb80-e700-4a59-84a5-11d54616cf9e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:31.194610 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-7f73fb80-e700-4a59-84a5-11d54616cf9e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:31.201695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7f73fb80-e700-4a59-84a5-11d54616cf9e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:31.202193 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7f73fb80-e700-4a59-84a5-11d54616cf9e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:31.202911 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7f73fb80-e700-4a59-84a5-11d54616cf9e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:31.203569 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7f73fb80-e700-4a59-84a5-11d54616cf9e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:31.377045 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7f73fb80-e700-4a59-84a5-11d54616cf9e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:31.386983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7f73fb80-e700-4a59-84a5-11d54616cf9e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:31.389402 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7f73fb80-e700-4a59-84a5-11d54616cf9e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:31.391062 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-7f73fb80-e700-4a59-84a5-11d54616cf9e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1739 microversion: 2.20 time: 0.202439 Aug 03 10:46:31.392229 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 163/332] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:31 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:31.408375 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cfda5e18-7850-475c-9c69-7edd3c62db77 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:31.410269 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-cfda5e18-7850-475c-9c69-7edd3c62db77 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:31.418264 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cfda5e18-7850-475c-9c69-7edd3c62db77 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:31.419003 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cfda5e18-7850-475c-9c69-7edd3c62db77 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:31.419991 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cfda5e18-7850-475c-9c69-7edd3c62db77 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:31.420431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cfda5e18-7850-475c-9c69-7edd3c62db77 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:31.512122 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-cfda5e18-7850-475c-9c69-7edd3c62db77 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:31.521073 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-cfda5e18-7850-475c-9c69-7edd3c62db77 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1298 microversion: 2.1 time: 0.124953 Aug 03 10:46:31.525965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 170/333] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:31 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1298 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:31.540438 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6527e152-2c84-4ab2-b4c9-a6e1d2bac4df tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:31.542093 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6527e152-2c84-4ab2-b4c9-a6e1d2bac4df tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:31.560856 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6527e152-2c84-4ab2-b4c9-a6e1d2bac4df tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:31.561797 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6527e152-2c84-4ab2-b4c9-a6e1d2bac4df tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:31.562976 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6527e152-2c84-4ab2-b4c9-a6e1d2bac4df tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:31.564095 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6527e152-2c84-4ab2-b4c9-a6e1d2bac4df tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:31.844644 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-6527e152-2c84-4ab2-b4c9-a6e1d2bac4df tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:31.858003 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-6527e152-2c84-4ab2-b4c9-a6e1d2bac4df tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.325490 Aug 03 10:46:31.860052 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 164/334] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:31 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:32.010080 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-f4d3d3eb-1e56-463f-8cf8-434a8912e7c3 req-08e2949d-c906-4b18-9e40-af1899fe9555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5895a291-434d-4b7c-85cd-0264cf37f5f3", "name": "network-vif-plugged", "status": "completed", "tag": "971e4968-4040-4784-a0ed-4c689d9711ff"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:32.025527 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-f4d3d3eb-1e56-463f-8cf8-434a8912e7c3 req-08e2949d-c906-4b18-9e40-af1899fe9555 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:32.025982 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-f4d3d3eb-1e56-463f-8cf8-434a8912e7c3 req-08e2949d-c906-4b18-9e40-af1899fe9555 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:32.039828 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-f4d3d3eb-1e56-463f-8cf8-434a8912e7c3 req-08e2949d-c906-4b18-9e40-af1899fe9555 service nova] Creating event network-vif-plugged:971e4968-4040-4784-a0ed-4c689d9711ff for instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 on hv-cinder-85083 Aug 03 10:46:32.045938 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-f4d3d3eb-1e56-463f-8cf8-434a8912e7c3 req-08e2949d-c906-4b18-9e40-af1899fe9555 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039062 Aug 03 10:46:32.046790 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 171/335] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:46:32.440780 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-8f8019f2-a23e-4b69-bdcd-4bf2ef55b271 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:32.442548 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-8f8019f2-a23e-4b69-bdcd-4bf2ef55b271 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:32.508002 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8f8019f2-a23e-4b69-bdcd-4bf2ef55b271 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:32.511778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8f8019f2-a23e-4b69-bdcd-4bf2ef55b271 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:32.513091 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8f8019f2-a23e-4b69-bdcd-4bf2ef55b271 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:32.513798 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8f8019f2-a23e-4b69-bdcd-4bf2ef55b271 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:32.543271 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ce621ab9-a8cc-489c-8ed5-bdeeb5044bd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:32.544787 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ce621ab9-a8cc-489c-8ed5-bdeeb5044bd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:32.552067 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce621ab9-a8cc-489c-8ed5-bdeeb5044bd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:32.552977 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce621ab9-a8cc-489c-8ed5-bdeeb5044bd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:32.554060 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce621ab9-a8cc-489c-8ed5-bdeeb5044bd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:32.554695 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce621ab9-a8cc-489c-8ed5-bdeeb5044bd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:32.633619 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ce621ab9-a8cc-489c-8ed5-bdeeb5044bd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:32.644595 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ce621ab9-a8cc-489c-8ed5-bdeeb5044bd7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1304 microversion: 2.1 time: 0.105333 Aug 03 10:46:32.645563 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 172/336] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:32 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:32.726566 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-8f8019f2-a23e-4b69-bdcd-4bf2ef55b271 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:32.735797 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-8f8019f2-a23e-4b69-bdcd-4bf2ef55b271 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:32.739622 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-8f8019f2-a23e-4b69-bdcd-4bf2ef55b271 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:32.740886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-8f8019f2-a23e-4b69-bdcd-4bf2ef55b271 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1739 microversion: 2.20 time: 0.319573 Aug 03 10:46:32.741834 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 165/337] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:32 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1739 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:32.897508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-506a80e3-3f5c-4b70-955f-839b1bfed0ac tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:32.897508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-506a80e3-3f5c-4b70-955f-839b1bfed0ac tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:32.906848 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-506a80e3-3f5c-4b70-955f-839b1bfed0ac tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:32.907671 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-506a80e3-3f5c-4b70-955f-839b1bfed0ac tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:32.909740 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-506a80e3-3f5c-4b70-955f-839b1bfed0ac tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:32.910628 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-506a80e3-3f5c-4b70-955f-839b1bfed0ac tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:33.075125 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1772979115", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "networks": [{"uuid": "7bee7923-de26-4c18-a8da-7229c320396a"}]}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:33.168608 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.network.neutron [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] validate_networks() for [('7bee7923-de26-4c18-a8da-7229c320396a', None, None, None, None, None)] {{(pid=124389) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:46:33.223353 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-506a80e3-3f5c-4b70-955f-839b1bfed0ac tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:33.232830 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-506a80e3-3f5c-4b70-955f-839b1bfed0ac tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.350206 Aug 03 10:46:33.234351 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 173/338] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:32 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:33.671029 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c1deff63-9fe1-4e92-9efc-89e7400d7088 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:33.671863 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c1deff63-9fe1-4e92-9efc-89e7400d7088 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:33.680083 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c1deff63-9fe1-4e92-9efc-89e7400d7088 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:33.681075 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c1deff63-9fe1-4e92-9efc-89e7400d7088 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:33.684872 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c1deff63-9fe1-4e92-9efc-89e7400d7088 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:33.685597 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c1deff63-9fe1-4e92-9efc-89e7400d7088 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:33.788165 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c1deff63-9fe1-4e92-9efc-89e7400d7088 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:33.799108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c1deff63-9fe1-4e92-9efc-89e7400d7088 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1304 microversion: 2.1 time: 0.134308 Aug 03 10:46:33.807359 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 174/339] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:33 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:33.825917 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-976375cf-bb1e-4480-8cdb-7f186865e631 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:33.833858 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-976375cf-bb1e-4480-8cdb-7f186865e631 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:33.852559 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-976375cf-bb1e-4480-8cdb-7f186865e631 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:33.862772 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-976375cf-bb1e-4480-8cdb-7f186865e631 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:33.863839 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-976375cf-bb1e-4480-8cdb-7f186865e631 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:33.864468 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-976375cf-bb1e-4480-8cdb-7f186865e631 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:33.907650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Flavor limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:46:33.908780 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Image limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:46:33.909597 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Flavor pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:46:33.910155 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Image pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:46:33.910802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:46:33.931108 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:33.931832 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:33.932805 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:33.933417 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:33.953663 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Getting quotas for project f9d4304db6d342e4ada925b6784e6d0d. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:46:33.958451 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Getting quotas for user 92485e486d53488eabf12105d1048e13 and project f9d4304db6d342e4ada925b6784e6d0d. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:46:33.980594 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Going to run 1 instances... {{(pid=124389) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:46:33.985717 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:46:34.073764 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-99ad8716-f210-4a3a-b6db-579922991d80 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.002637 Aug 03 10:46:34.078633 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 166/340] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:46:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:46:34.089157 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-22569cc8-91fd-47cf-893f-899c796c7ddc tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:34.091934 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-22569cc8-91fd-47cf-893f-899c796c7ddc tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:34.122648 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-976375cf-bb1e-4480-8cdb-7f186865e631 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:34.134415 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-976375cf-bb1e-4480-8cdb-7f186865e631 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:34.137109 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-976375cf-bb1e-4480-8cdb-7f186865e631 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:34.142730 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-976375cf-bb1e-4480-8cdb-7f186865e631 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1739 microversion: 2.20 time: 0.330842 Aug 03 10:46:34.145168 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 175/341] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:33 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:34.170651 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-22569cc8-91fd-47cf-893f-899c796c7ddc tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:34.181772 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-22569cc8-91fd-47cf-893f-899c796c7ddc tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1219 microversion: 2.1 time: 0.096522 Aug 03 10:46:34.182790 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 167/342] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:34 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:34.255571 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-120e69bf-d25d-486c-b3df-23cd459c79a4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:34.256465 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-120e69bf-d25d-486c-b3df-23cd459c79a4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:34.268111 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-120e69bf-d25d-486c-b3df-23cd459c79a4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:34.268795 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-120e69bf-d25d-486c-b3df-23cd459c79a4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:34.269828 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-120e69bf-d25d-486c-b3df-23cd459c79a4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:34.272261 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-120e69bf-d25d-486c-b3df-23cd459c79a4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:34.443894 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-120e69bf-d25d-486c-b3df-23cd459c79a4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:34.452349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-120e69bf-d25d-486c-b3df-23cd459c79a4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.200498 Aug 03 10:46:34.457804 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 176/343] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:34 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:34.824699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e21cb727-a312-4b58-83c0-082718d99dff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:34.825575 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e21cb727-a312-4b58-83c0-082718d99dff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:34.842846 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e21cb727-a312-4b58-83c0-082718d99dff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:34.843105 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e21cb727-a312-4b58-83c0-082718d99dff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:34.846914 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e21cb727-a312-4b58-83c0-082718d99dff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:34.847490 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e21cb727-a312-4b58-83c0-082718d99dff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:34.953426 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e21cb727-a312-4b58-83c0-082718d99dff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:34.962783 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e21cb727-a312-4b58-83c0-082718d99dff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1304 microversion: 2.1 time: 0.143631 Aug 03 10:46:34.963716 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 168/344] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:34 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:35.172318 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b829a0ad-d690-42e4-a525-3c4cf25d5eb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:35.174623 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b829a0ad-d690-42e4-a525-3c4cf25d5eb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:35.185768 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b829a0ad-d690-42e4-a525-3c4cf25d5eb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:35.187087 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b829a0ad-d690-42e4-a525-3c4cf25d5eb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:35.189183 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b829a0ad-d690-42e4-a525-3c4cf25d5eb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:35.190093 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b829a0ad-d690-42e4-a525-3c4cf25d5eb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:35.212262 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c294b778-887f-4fec-9fba-b02b025c3680 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:35.214002 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-c294b778-887f-4fec-9fba-b02b025c3680 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:35.234048 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c294b778-887f-4fec-9fba-b02b025c3680 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:35.235722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c294b778-887f-4fec-9fba-b02b025c3680 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:35.240594 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c294b778-887f-4fec-9fba-b02b025c3680 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:35.242175 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c294b778-887f-4fec-9fba-b02b025c3680 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:35.402974 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c294b778-887f-4fec-9fba-b02b025c3680 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:35.415987 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c294b778-887f-4fec-9fba-b02b025c3680 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1223 microversion: 2.1 time: 0.212675 Aug 03 10:46:35.417527 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 169/345] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:35 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1223 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:35.475784 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-30dbf462-4215-4fbd-93d4-dcd56455cdb9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:35.476629 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-30dbf462-4215-4fbd-93d4-dcd56455cdb9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:35.484396 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:35.489430 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-30dbf462-4215-4fbd-93d4-dcd56455cdb9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:35.490088 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-30dbf462-4215-4fbd-93d4-dcd56455cdb9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:35.492147 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-30dbf462-4215-4fbd-93d4-dcd56455cdb9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:35.492319 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-30dbf462-4215-4fbd-93d4-dcd56455cdb9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:35.521668 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b829a0ad-d690-42e4-a525-3c4cf25d5eb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:35.553224 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b829a0ad-d690-42e4-a525-3c4cf25d5eb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:35.556606 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b829a0ad-d690-42e4-a525-3c4cf25d5eb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:35.558069 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b829a0ad-d690-42e4-a525-3c4cf25d5eb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1739 microversion: 2.20 time: 0.392588 Aug 03 10:46:35.558659 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 177/346] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:35 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:35.745370 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-30dbf462-4215-4fbd-93d4-dcd56455cdb9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:35.760906 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-30dbf462-4215-4fbd-93d4-dcd56455cdb9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.290904 Aug 03 10:46:35.773527 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 170/347] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:35 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:35.990940 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e0301670-7d3a-46bc-b101-b832d6476bd4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:35.991499 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e0301670-7d3a-46bc-b101-b832d6476bd4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:36.002132 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e0301670-7d3a-46bc-b101-b832d6476bd4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:36.002863 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e0301670-7d3a-46bc-b101-b832d6476bd4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:36.003949 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e0301670-7d3a-46bc-b101-b832d6476bd4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:36.004441 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e0301670-7d3a-46bc-b101-b832d6476bd4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:36.144616 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e0301670-7d3a-46bc-b101-b832d6476bd4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:36.161265 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e0301670-7d3a-46bc-b101-b832d6476bd4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1304 microversion: 2.1 time: 0.176228 Aug 03 10:46:36.169369 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 178/348] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:35 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1304 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:36.462659 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-15f0af57-d403-4de3-888c-2cc7e3ddc58f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:36.463703 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-15f0af57-d403-4de3-888c-2cc7e3ddc58f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:36.473093 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-15f0af57-d403-4de3-888c-2cc7e3ddc58f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:36.473576 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-15f0af57-d403-4de3-888c-2cc7e3ddc58f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:36.475346 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-15f0af57-d403-4de3-888c-2cc7e3ddc58f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:36.476328 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-15f0af57-d403-4de3-888c-2cc7e3ddc58f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:36.496819 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=100 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:36.549257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-15f0af57-d403-4de3-888c-2cc7e3ddc58f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:36.558885 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-15f0af57-d403-4de3-888c-2cc7e3ddc58f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1223 microversion: 2.1 time: 0.109137 Aug 03 10:46:36.559786 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 171/349] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:36 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:36.592780 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1ee02784-a43a-4af0-9ca0-5bce438ded74 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:36.594419 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1ee02784-a43a-4af0-9ca0-5bce438ded74 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:36.602047 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1ee02784-a43a-4af0-9ca0-5bce438ded74 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:36.602878 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1ee02784-a43a-4af0-9ca0-5bce438ded74 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:36.603948 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1ee02784-a43a-4af0-9ca0-5bce438ded74 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:36.604608 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1ee02784-a43a-4af0-9ca0-5bce438ded74 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:36.798716 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ca2334e5-9aae-49ba-80c6-2b11eeed1d66 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:36.800905 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-ca2334e5-9aae-49ba-80c6-2b11eeed1d66 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:36.813692 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ca2334e5-9aae-49ba-80c6-2b11eeed1d66 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:36.814888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ca2334e5-9aae-49ba-80c6-2b11eeed1d66 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:36.817552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ca2334e5-9aae-49ba-80c6-2b11eeed1d66 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:36.818277 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ca2334e5-9aae-49ba-80c6-2b11eeed1d66 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:36.845711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1ee02784-a43a-4af0-9ca0-5bce438ded74 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:36.862853 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1ee02784-a43a-4af0-9ca0-5bce438ded74 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:36.865433 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1ee02784-a43a-4af0-9ca0-5bce438ded74 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:36.867671 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1ee02784-a43a-4af0-9ca0-5bce438ded74 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1739 microversion: 2.20 time: 0.278444 Aug 03 10:46:36.879096 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 179/350] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:36 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1739 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:46:37.022598 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-ca2334e5-9aae-49ba-80c6-2b11eeed1d66 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:37.038480 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ca2334e5-9aae-49ba-80c6-2b11eeed1d66 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.256572 Aug 03 10:46:37.039453 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 172/351] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:36 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:37.203704 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8b1041f8-7b16-45de-b2ae-7fde15892a9e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:37.205745 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8b1041f8-7b16-45de-b2ae-7fde15892a9e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:37.220386 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b1041f8-7b16-45de-b2ae-7fde15892a9e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:37.222441 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b1041f8-7b16-45de-b2ae-7fde15892a9e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:37.224978 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b1041f8-7b16-45de-b2ae-7fde15892a9e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:37.226662 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b1041f8-7b16-45de-b2ae-7fde15892a9e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:37.329198 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8b1041f8-7b16-45de-b2ae-7fde15892a9e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:37.338370 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8b1041f8-7b16-45de-b2ae-7fde15892a9e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1304 microversion: 2.1 time: 0.148762 Aug 03 10:46:37.338954 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 180/352] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:37 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:37.584935 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c72b3f7d-1e28-41e9-b3f5-deaee2dca50e tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:37.586365 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-c72b3f7d-1e28-41e9-b3f5-deaee2dca50e tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:37.599383 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c72b3f7d-1e28-41e9-b3f5-deaee2dca50e tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:37.600575 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c72b3f7d-1e28-41e9-b3f5-deaee2dca50e tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:37.602102 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c72b3f7d-1e28-41e9-b3f5-deaee2dca50e tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:37.603242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c72b3f7d-1e28-41e9-b3f5-deaee2dca50e tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:37.759387 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c72b3f7d-1e28-41e9-b3f5-deaee2dca50e tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:37.770412 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c72b3f7d-1e28-41e9-b3f5-deaee2dca50e tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1223 microversion: 2.1 time: 0.191850 Aug 03 10:46:37.772067 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 173/353] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:37 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1223 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:37.905437 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9a8208a9-3f4e-420f-ada9-0b1789bb2228 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:37.919550 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9a8208a9-3f4e-420f-ada9-0b1789bb2228 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:37.936607 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:37.939556 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9a8208a9-3f4e-420f-ada9-0b1789bb2228 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:37.941748 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9a8208a9-3f4e-420f-ada9-0b1789bb2228 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:37.943271 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9a8208a9-3f4e-420f-ada9-0b1789bb2228 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:37.944131 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9a8208a9-3f4e-420f-ada9-0b1789bb2228 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:38.061496 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9adc38b1-e08f-4aa2-8ad2-93c44b68f9a0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:38.063649 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9adc38b1-e08f-4aa2-8ad2-93c44b68f9a0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:38.078409 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9adc38b1-e08f-4aa2-8ad2-93c44b68f9a0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:38.085213 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9adc38b1-e08f-4aa2-8ad2-93c44b68f9a0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:38.088741 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9adc38b1-e08f-4aa2-8ad2-93c44b68f9a0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:38.093849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9adc38b1-e08f-4aa2-8ad2-93c44b68f9a0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:38.142453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9a8208a9-3f4e-420f-ada9-0b1789bb2228 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:38.161907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9a8208a9-3f4e-420f-ada9-0b1789bb2228 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:38.163763 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9a8208a9-3f4e-420f-ada9-0b1789bb2228 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:38.185328 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9a8208a9-3f4e-420f-ada9-0b1789bb2228 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1739 microversion: 2.20 time: 0.294877 Aug 03 10:46:38.189605 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 181/354] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:37 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:38.383720 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b65c6e62-abd1-406b-b81d-20fe5fa90135 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:38.390029 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b65c6e62-abd1-406b-b81d-20fe5fa90135 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:38.402766 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b65c6e62-abd1-406b-b81d-20fe5fa90135 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:38.403987 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b65c6e62-abd1-406b-b81d-20fe5fa90135 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:38.405811 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b65c6e62-abd1-406b-b81d-20fe5fa90135 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:38.406940 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b65c6e62-abd1-406b-b81d-20fe5fa90135 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:38.427841 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9adc38b1-e08f-4aa2-8ad2-93c44b68f9a0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:38.446432 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9adc38b1-e08f-4aa2-8ad2-93c44b68f9a0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.388757 Aug 03 10:46:38.474117 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 174/355] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:38 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:38.727192 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b65c6e62-abd1-406b-b81d-20fe5fa90135 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:38.797130 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b95a29c2-5f4d-4d94-bb03-9b47836e8125 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:38.799207 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b95a29c2-5f4d-4d94-bb03-9b47836e8125 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:38.808937 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b65c6e62-abd1-406b-b81d-20fe5fa90135 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1304 microversion: 2.1 time: 0.441495 Aug 03 10:46:38.826786 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b95a29c2-5f4d-4d94-bb03-9b47836e8125 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:38.828152 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b95a29c2-5f4d-4d94-bb03-9b47836e8125 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:38.830079 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b95a29c2-5f4d-4d94-bb03-9b47836e8125 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:38.833799 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 182/356] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:38 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1304 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:38.838589 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b95a29c2-5f4d-4d94-bb03-9b47836e8125 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:39.215153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-463228bf-c67c-44ad-b7bf-70f4239ddf6c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:39.216574 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-463228bf-c67c-44ad-b7bf-70f4239ddf6c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:39.230423 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-463228bf-c67c-44ad-b7bf-70f4239ddf6c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:39.231368 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-463228bf-c67c-44ad-b7bf-70f4239ddf6c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:39.234181 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-463228bf-c67c-44ad-b7bf-70f4239ddf6c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:39.236393 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-463228bf-c67c-44ad-b7bf-70f4239ddf6c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:39.303806 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b95a29c2-5f4d-4d94-bb03-9b47836e8125 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:39.352006 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b95a29c2-5f4d-4d94-bb03-9b47836e8125 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1215 microversion: 2.1 time: 0.559517 Aug 03 10:46:39.373675 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 175/357] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:38 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1215 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:39.494487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9675c3ad-c2ab-4687-9fa6-8778d3a1b6f4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:39.495420 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9675c3ad-c2ab-4687-9fa6-8778d3a1b6f4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:39.510561 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9675c3ad-c2ab-4687-9fa6-8778d3a1b6f4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:39.511345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9675c3ad-c2ab-4687-9fa6-8778d3a1b6f4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:39.515064 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9675c3ad-c2ab-4687-9fa6-8778d3a1b6f4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:39.515796 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9675c3ad-c2ab-4687-9fa6-8778d3a1b6f4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:39.681828 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-463228bf-c67c-44ad-b7bf-70f4239ddf6c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:39.708022 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-463228bf-c67c-44ad-b7bf-70f4239ddf6c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:39.711745 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-463228bf-c67c-44ad-b7bf-70f4239ddf6c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:39.713742 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-463228bf-c67c-44ad-b7bf-70f4239ddf6c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1739 microversion: 2.20 time: 0.503458 Aug 03 10:46:39.714961 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 183/358] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:39 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1739 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:46:39.873448 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f7d75ae8-f074-4815-af36-bfea0ed207e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:39.880036 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9675c3ad-c2ab-4687-9fa6-8778d3a1b6f4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:39.880891 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f7d75ae8-f074-4815-af36-bfea0ed207e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:39.892491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f7d75ae8-f074-4815-af36-bfea0ed207e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:39.894946 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f7d75ae8-f074-4815-af36-bfea0ed207e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:39.896367 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f7d75ae8-f074-4815-af36-bfea0ed207e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:39.897084 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f7d75ae8-f074-4815-af36-bfea0ed207e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:39.905910 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9675c3ad-c2ab-4687-9fa6-8778d3a1b6f4 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.416927 Aug 03 10:46:39.907205 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 176/359] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:39 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:40.205030 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f7d75ae8-f074-4815-af36-bfea0ed207e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:40.230857 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f7d75ae8-f074-4815-af36-bfea0ed207e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1371 microversion: 2.1 time: 0.370494 Aug 03 10:46:40.235803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 184/360] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:39 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1371 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:40.397350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5a61ff00-16bc-4f41-9ecd-72a9ec891189 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:40.402899 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-5a61ff00-16bc-4f41-9ecd-72a9ec891189 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:40.432678 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5a61ff00-16bc-4f41-9ecd-72a9ec891189 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:40.434088 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5a61ff00-16bc-4f41-9ecd-72a9ec891189 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:40.436433 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5a61ff00-16bc-4f41-9ecd-72a9ec891189 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:40.437118 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5a61ff00-16bc-4f41-9ecd-72a9ec891189 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:40.578471 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5a61ff00-16bc-4f41-9ecd-72a9ec891189 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:40.605315 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5a61ff00-16bc-4f41-9ecd-72a9ec891189 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1289 microversion: 2.1 time: 0.217951 Aug 03 10:46:40.619483 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 177/361] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:40 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1289 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:40.743088 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8520f9e4-38d5-4d93-9367-3dd6868969ea tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:40.746283 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8520f9e4-38d5-4d93-9367-3dd6868969ea tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:40.762646 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8520f9e4-38d5-4d93-9367-3dd6868969ea tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:40.769096 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8520f9e4-38d5-4d93-9367-3dd6868969ea tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:40.770503 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8520f9e4-38d5-4d93-9367-3dd6868969ea tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:40.771262 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8520f9e4-38d5-4d93-9367-3dd6868969ea tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:40.962006 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6aa3cf6a-544e-413e-971a-624967e3f26f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:40.964187 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6aa3cf6a-544e-413e-971a-624967e3f26f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:40.978220 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6aa3cf6a-544e-413e-971a-624967e3f26f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:40.979406 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6aa3cf6a-544e-413e-971a-624967e3f26f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:40.980668 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6aa3cf6a-544e-413e-971a-624967e3f26f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:40.981654 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6aa3cf6a-544e-413e-971a-624967e3f26f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:41.234431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8520f9e4-38d5-4d93-9367-3dd6868969ea tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:41.269780 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8520f9e4-38d5-4d93-9367-3dd6868969ea tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:41.274018 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8520f9e4-38d5-4d93-9367-3dd6868969ea tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:41.277951 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8520f9e4-38d5-4d93-9367-3dd6868969ea tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1739 microversion: 2.20 time: 0.539443 Aug 03 10:46:41.280002 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 185/362] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:40 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1739 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:46:41.294517 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-84a6e061-7491-4149-9687-befb1599da01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:41.297490 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-84a6e061-7491-4149-9687-befb1599da01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:41.315314 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-84a6e061-7491-4149-9687-befb1599da01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:41.316485 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-84a6e061-7491-4149-9687-befb1599da01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:41.318539 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-84a6e061-7491-4149-9687-befb1599da01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:41.319369 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-6aa3cf6a-544e-413e-971a-624967e3f26f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:41.319883 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-84a6e061-7491-4149-9687-befb1599da01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:41.333159 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-6aa3cf6a-544e-413e-971a-624967e3f26f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.380646 Aug 03 10:46:41.345571 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 178/363] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:40 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:41.589788 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-84a6e061-7491-4149-9687-befb1599da01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:41.592421 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:41.605745 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-84a6e061-7491-4149-9687-befb1599da01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1371 microversion: 2.1 time: 0.323489 Aug 03 10:46:41.606341 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 186/364] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:41 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:41.629832 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b8dc5a46-3f5e-4a72-8d7b-c7e4e50a3fb8 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:41.630195 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b8dc5a46-3f5e-4a72-8d7b-c7e4e50a3fb8 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:41.643677 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b8dc5a46-3f5e-4a72-8d7b-c7e4e50a3fb8 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:41.644401 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b8dc5a46-3f5e-4a72-8d7b-c7e4e50a3fb8 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:41.645422 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b8dc5a46-3f5e-4a72-8d7b-c7e4e50a3fb8 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:41.646077 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b8dc5a46-3f5e-4a72-8d7b-c7e4e50a3fb8 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:41.879975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b8dc5a46-3f5e-4a72-8d7b-c7e4e50a3fb8 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:41.939233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b8dc5a46-3f5e-4a72-8d7b-c7e4e50a3fb8 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1277 microversion: 2.1 time: 0.311507 Aug 03 10:46:41.941267 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 179/365] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:41 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1277 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:42.040692 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-a0215fba-af8f-491c-9d48-a62b570f339e req-cd17deac-7a0e-4cac-b157-09b0b72200f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b0240d-3638-48b2-a7f3-2269dd2aba05", "tag": "3a081129-4296-482f-9f57-79ce242de7a4"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:42.070261 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-a0215fba-af8f-491c-9d48-a62b570f339e req-cd17deac-7a0e-4cac-b157-09b0b72200f7 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:42.071655 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-a0215fba-af8f-491c-9d48-a62b570f339e req-cd17deac-7a0e-4cac-b157-09b0b72200f7 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:42.121866 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-a0215fba-af8f-491c-9d48-a62b570f339e req-cd17deac-7a0e-4cac-b157-09b0b72200f7 service nova] Creating event network-changed:3a081129-4296-482f-9f57-79ce242de7a4 for instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 on hv-cinder-85083 Aug 03 10:46:42.133682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-a0215fba-af8f-491c-9d48-a62b570f339e req-cd17deac-7a0e-4cac-b157-09b0b72200f7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101149 Aug 03 10:46:42.134974 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 187/366] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:46:42.309928 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-aae94fa9-ea35-4891-a8c2-f149aa168b15 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:42.310593 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-aae94fa9-ea35-4891-a8c2-f149aa168b15 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:42.321805 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aae94fa9-ea35-4891-a8c2-f149aa168b15 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:42.323065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aae94fa9-ea35-4891-a8c2-f149aa168b15 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:42.324043 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aae94fa9-ea35-4891-a8c2-f149aa168b15 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:42.324760 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aae94fa9-ea35-4891-a8c2-f149aa168b15 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:42.389568 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fe76b9ec-b1ce-4847-889e-11fcd2fa5135 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:42.399214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fe76b9ec-b1ce-4847-889e-11fcd2fa5135 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:42.425730 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fe76b9ec-b1ce-4847-889e-11fcd2fa5135 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:42.438605 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fe76b9ec-b1ce-4847-889e-11fcd2fa5135 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:42.441803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fe76b9ec-b1ce-4847-889e-11fcd2fa5135 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:42.442353 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fe76b9ec-b1ce-4847-889e-11fcd2fa5135 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:42.569044 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-aae94fa9-ea35-4891-a8c2-f149aa168b15 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:42.583430 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-aae94fa9-ea35-4891-a8c2-f149aa168b15 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:42.586279 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-aae94fa9-ea35-4891-a8c2-f149aa168b15 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:42.587792 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-aae94fa9-ea35-4891-a8c2-f149aa168b15 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1739 microversion: 2.20 time: 0.283312 Aug 03 10:46:42.589709 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 180/367] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:42 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:46:42.638424 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-8d9c2f21-bbfc-4703-acb2-f44af706cdfa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:42.639153 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-8d9c2f21-bbfc-4703-acb2-f44af706cdfa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:42.665216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8d9c2f21-bbfc-4703-acb2-f44af706cdfa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:42.665729 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8d9c2f21-bbfc-4703-acb2-f44af706cdfa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:42.680378 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8d9c2f21-bbfc-4703-acb2-f44af706cdfa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:42.680898 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8d9c2f21-bbfc-4703-acb2-f44af706cdfa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:42.922250 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-fe76b9ec-b1ce-4847-889e-11fcd2fa5135 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:42.935615 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fe76b9ec-b1ce-4847-889e-11fcd2fa5135 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.581044 Aug 03 10:46:42.936546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 188/368] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:42 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:42.983174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0e69c7a4-b6f7-4f67-bc70-1c820acf00d5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:42.984254 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0e69c7a4-b6f7-4f67-bc70-1c820acf00d5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:43.001247 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0e69c7a4-b6f7-4f67-bc70-1c820acf00d5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:43.001880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0e69c7a4-b6f7-4f67-bc70-1c820acf00d5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:43.008099 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0e69c7a4-b6f7-4f67-bc70-1c820acf00d5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:43.008972 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0e69c7a4-b6f7-4f67-bc70-1c820acf00d5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:43.034702 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-8d9c2f21-bbfc-4703-acb2-f44af706cdfa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:43.051859 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-8d9c2f21-bbfc-4703-acb2-f44af706cdfa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1371 microversion: 2.1 time: 0.418277 Aug 03 10:46:43.054554 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 181/369] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:42 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1371 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:43.200133 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0e69c7a4-b6f7-4f67-bc70-1c820acf00d5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:43.228152 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0e69c7a4-b6f7-4f67-bc70-1c820acf00d5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1319 microversion: 2.1 time: 0.250441 Aug 03 10:46:43.233962 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 189/370] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:42 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:43.623187 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-aa3b8b91-638a-43ac-a4af-257c8e3a9b59 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:43.623804 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-aa3b8b91-638a-43ac-a4af-257c8e3a9b59 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:43.633252 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aa3b8b91-638a-43ac-a4af-257c8e3a9b59 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:43.633746 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aa3b8b91-638a-43ac-a4af-257c8e3a9b59 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:43.634558 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aa3b8b91-638a-43ac-a4af-257c8e3a9b59 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:43.635003 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aa3b8b91-638a-43ac-a4af-257c8e3a9b59 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:43.845415 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-aa3b8b91-638a-43ac-a4af-257c8e3a9b59 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:43.864392 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-aa3b8b91-638a-43ac-a4af-257c8e3a9b59 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:43.868805 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-aa3b8b91-638a-43ac-a4af-257c8e3a9b59 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:43.871553 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-aa3b8b91-638a-43ac-a4af-257c8e3a9b59 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1739 microversion: 2.20 time: 0.256177 Aug 03 10:46:43.872579 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 182/371] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:43 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:43.963145 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0d08c068-eb28-40b3-a90d-367bd282c14a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:43.965188 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0d08c068-eb28-40b3-a90d-367bd282c14a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:43.974658 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d08c068-eb28-40b3-a90d-367bd282c14a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:43.975601 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d08c068-eb28-40b3-a90d-367bd282c14a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:43.976960 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d08c068-eb28-40b3-a90d-367bd282c14a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:43.977588 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d08c068-eb28-40b3-a90d-367bd282c14a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:44.084990 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6355b1e2-9cfd-472b-82e6-b6726d4ee382 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:44.086097 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6355b1e2-9cfd-472b-82e6-b6726d4ee382 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:44.088294 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=4 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:44.100132 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6355b1e2-9cfd-472b-82e6-b6726d4ee382 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:44.101717 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6355b1e2-9cfd-472b-82e6-b6726d4ee382 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:44.102690 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6355b1e2-9cfd-472b-82e6-b6726d4ee382 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:44.105248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6355b1e2-9cfd-472b-82e6-b6726d4ee382 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:44.189425 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=18 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:44.283072 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0d08c068-eb28-40b3-a90d-367bd282c14a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:44.301641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0d08c068-eb28-40b3-a90d-367bd282c14a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.344380 Aug 03 10:46:44.318670 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 190/372] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:43 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:44.334733 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-b256b37c-811a-4db2-87ad-6bfa91682d37 req-f2d12bf5-e511-4ba0-8313-96fa37db2e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e1399d5-9f28-4b92-a752-a233a1652022", "name": "network-vif-plugged", "status": "completed", "tag": "ea1ca950-d067-4257-9371-6667208eda63"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:44.366934 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-b256b37c-811a-4db2-87ad-6bfa91682d37 req-f2d12bf5-e511-4ba0-8313-96fa37db2e85 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:44.374251 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-b256b37c-811a-4db2-87ad-6bfa91682d37 req-f2d12bf5-e511-4ba0-8313-96fa37db2e85 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:44.392376 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-6355b1e2-9cfd-472b-82e6-b6726d4ee382 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:44.402050 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-6355b1e2-9cfd-472b-82e6-b6726d4ee382 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1371 microversion: 2.1 time: 0.321170 Aug 03 10:46:44.402967 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 183/373] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:44 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:44.408647 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e8c372dc-c21b-4de9-a3b5-6c23d734c3b7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:44.410156 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e8c372dc-c21b-4de9-a3b5-6c23d734c3b7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:44.431388 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e8c372dc-c21b-4de9-a3b5-6c23d734c3b7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:44.434412 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-b256b37c-811a-4db2-87ad-6bfa91682d37 req-f2d12bf5-e511-4ba0-8313-96fa37db2e85 service nova] Creating event network-vif-plugged:ea1ca950-d067-4257-9371-6667208eda63 for instance 7e1399d5-9f28-4b92-a752-a233a1652022 on hv-cinder-85083 Aug 03 10:46:44.435385 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e8c372dc-c21b-4de9-a3b5-6c23d734c3b7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:44.436392 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e8c372dc-c21b-4de9-a3b5-6c23d734c3b7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:44.436916 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e8c372dc-c21b-4de9-a3b5-6c23d734c3b7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:44.442311 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-b256b37c-811a-4db2-87ad-6bfa91682d37 req-f2d12bf5-e511-4ba0-8313-96fa37db2e85 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121638 Aug 03 10:46:44.443871 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 191/374] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:46:44.603444 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-b080a0e4-dddf-4e18-bb77-d92523abe92e req-a0ff10fc-9904-4308-a373-6d0ce69171ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "476109cf-f3fe-42cd-b1dd-aadbe1c56a52", "tag": "075ed4cf-bf99-45c6-b995-b90ac6821b48"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:44.618418 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-b080a0e4-dddf-4e18-bb77-d92523abe92e req-a0ff10fc-9904-4308-a373-6d0ce69171ab service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:44.619277 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-b080a0e4-dddf-4e18-bb77-d92523abe92e req-a0ff10fc-9904-4308-a373-6d0ce69171ab service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:44.623692 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e8c372dc-c21b-4de9-a3b5-6c23d734c3b7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:44.632747 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e8c372dc-c21b-4de9-a3b5-6c23d734c3b7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1319 microversion: 2.1 time: 0.228094 Aug 03 10:46:44.633350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 184/375] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:44 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:44.637695 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-b080a0e4-dddf-4e18-bb77-d92523abe92e req-a0ff10fc-9904-4308-a373-6d0ce69171ab service nova] Creating event network-changed:075ed4cf-bf99-45c6-b995-b90ac6821b48 for instance 476109cf-f3fe-42cd-b1dd-aadbe1c56a52 on hv-cinder-85083 Aug 03 10:46:44.642836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-b080a0e4-dddf-4e18-bb77-d92523abe92e req-a0ff10fc-9904-4308-a373-6d0ce69171ab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043711 Aug 03 10:46:44.644152 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 192/376] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:46:44.922232 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3506d7b3-3cba-461d-82d6-cf2a86ce43ac tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:44.922844 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3506d7b3-3cba-461d-82d6-cf2a86ce43ac tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:44.929392 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3506d7b3-3cba-461d-82d6-cf2a86ce43ac tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:44.930471 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3506d7b3-3cba-461d-82d6-cf2a86ce43ac tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:44.931485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3506d7b3-3cba-461d-82d6-cf2a86ce43ac tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:44.931924 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3506d7b3-3cba-461d-82d6-cf2a86ce43ac tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:45.142583 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3506d7b3-3cba-461d-82d6-cf2a86ce43ac tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:45.160761 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3506d7b3-3cba-461d-82d6-cf2a86ce43ac tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:45.164009 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3506d7b3-3cba-461d-82d6-cf2a86ce43ac tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:45.166604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3506d7b3-3cba-461d-82d6-cf2a86ce43ac tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1721 microversion: 2.20 time: 0.249167 Aug 03 10:46:45.167510 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 185/377] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:44 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1721 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:46:45.341316 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d4b692f0-aa1c-473c-858d-4c79dba81290 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:45.342732 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d4b692f0-aa1c-473c-858d-4c79dba81290 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:45.354430 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d4b692f0-aa1c-473c-858d-4c79dba81290 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:45.354430 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d4b692f0-aa1c-473c-858d-4c79dba81290 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:45.354430 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d4b692f0-aa1c-473c-858d-4c79dba81290 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:45.354430 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d4b692f0-aa1c-473c-858d-4c79dba81290 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:45.439695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-217a4180-ac20-4f91-8993-ca4c05a251ff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:45.443002 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-217a4180-ac20-4f91-8993-ca4c05a251ff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:45.458005 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-217a4180-ac20-4f91-8993-ca4c05a251ff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:45.461327 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-217a4180-ac20-4f91-8993-ca4c05a251ff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:45.465498 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-217a4180-ac20-4f91-8993-ca4c05a251ff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:45.466661 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-217a4180-ac20-4f91-8993-ca4c05a251ff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:45.542223 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d4b692f0-aa1c-473c-858d-4c79dba81290 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:45.550314 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d4b692f0-aa1c-473c-858d-4c79dba81290 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.217005 Aug 03 10:46:45.550893 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 193/378] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:45 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:45.657026 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6170ae4b-88cf-4197-8932-ef544dd9fca0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:45.658230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6170ae4b-88cf-4197-8932-ef544dd9fca0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:45.667752 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6170ae4b-88cf-4197-8932-ef544dd9fca0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:45.668233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6170ae4b-88cf-4197-8932-ef544dd9fca0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:45.669037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6170ae4b-88cf-4197-8932-ef544dd9fca0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:45.669523 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6170ae4b-88cf-4197-8932-ef544dd9fca0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:45.711092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-217a4180-ac20-4f91-8993-ca4c05a251ff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:45.722791 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-217a4180-ac20-4f91-8993-ca4c05a251ff tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1371 microversion: 2.1 time: 0.296596 Aug 03 10:46:45.723383 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 186/379] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:45 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:45.868439 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6170ae4b-88cf-4197-8932-ef544dd9fca0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:45.878806 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6170ae4b-88cf-4197-8932-ef544dd9fca0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1319 microversion: 2.1 time: 0.227405 Aug 03 10:46:45.879387 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 194/380] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:45 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:46.204812 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-854227d8-a6b9-4b3f-bb59-acb7624d46cb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:46.205419 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-854227d8-a6b9-4b3f-bb59-acb7624d46cb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:46.212719 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-854227d8-a6b9-4b3f-bb59-acb7624d46cb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:46.213175 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-854227d8-a6b9-4b3f-bb59-acb7624d46cb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:46.214014 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-854227d8-a6b9-4b3f-bb59-acb7624d46cb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:46.214478 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-854227d8-a6b9-4b3f-bb59-acb7624d46cb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:46.412684 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-854227d8-a6b9-4b3f-bb59-acb7624d46cb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:46.421266 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-854227d8-a6b9-4b3f-bb59-acb7624d46cb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:46.422891 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-854227d8-a6b9-4b3f-bb59-acb7624d46cb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:46.424104 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-854227d8-a6b9-4b3f-bb59-acb7624d46cb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1721 microversion: 2.20 time: 0.223755 Aug 03 10:46:46.425136 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 187/381] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:46 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:46.587757 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-391e71ee-26de-4589-ba0e-76de044c01fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:46.588307 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-391e71ee-26de-4589-ba0e-76de044c01fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:46.596464 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-391e71ee-26de-4589-ba0e-76de044c01fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:46.598646 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-391e71ee-26de-4589-ba0e-76de044c01fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:46.602488 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-391e71ee-26de-4589-ba0e-76de044c01fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:46.603137 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-391e71ee-26de-4589-ba0e-76de044c01fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:46.744943 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3754eb6b-3dca-4185-a9c8-31175ef866ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:46.745703 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3754eb6b-3dca-4185-a9c8-31175ef866ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:46.754197 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3754eb6b-3dca-4185-a9c8-31175ef866ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:46.754827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3754eb6b-3dca-4185-a9c8-31175ef866ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:46.756045 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3754eb6b-3dca-4185-a9c8-31175ef866ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:46.756518 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3754eb6b-3dca-4185-a9c8-31175ef866ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:46.761575 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=100 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:46.832923 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-391e71ee-26de-4589-ba0e-76de044c01fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:46.845321 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-391e71ee-26de-4589-ba0e-76de044c01fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1260 microversion: 2.1 time: 0.261284 Aug 03 10:46:46.847167 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 195/382] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:46 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:46.911846 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5d8d6ac3-afc7-412e-b329-287af040f2cc tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:46.912463 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5d8d6ac3-afc7-412e-b329-287af040f2cc tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:46.918497 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5d8d6ac3-afc7-412e-b329-287af040f2cc tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:46.918944 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5d8d6ac3-afc7-412e-b329-287af040f2cc tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:46.919719 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5d8d6ac3-afc7-412e-b329-287af040f2cc tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:46.920152 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5d8d6ac3-afc7-412e-b329-287af040f2cc tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:46.946581 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3754eb6b-3dca-4185-a9c8-31175ef866ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:46.968852 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3754eb6b-3dca-4185-a9c8-31175ef866ba tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1371 microversion: 2.1 time: 0.228327 Aug 03 10:46:46.969816 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 188/383] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:46 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:47.084412 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5d8d6ac3-afc7-412e-b329-287af040f2cc tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:47.092558 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5d8d6ac3-afc7-412e-b329-287af040f2cc tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1319 microversion: 2.1 time: 0.185054 Aug 03 10:46:47.093740 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 196/384] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:46 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:47.458285 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-fb1a770e-ac9b-4f7d-ad31-c2ad54196ed5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:47.458920 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-fb1a770e-ac9b-4f7d-ad31-c2ad54196ed5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:47.465277 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fb1a770e-ac9b-4f7d-ad31-c2ad54196ed5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:47.465753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fb1a770e-ac9b-4f7d-ad31-c2ad54196ed5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:47.466529 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fb1a770e-ac9b-4f7d-ad31-c2ad54196ed5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:47.466957 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fb1a770e-ac9b-4f7d-ad31-c2ad54196ed5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:47.644177 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fb1a770e-ac9b-4f7d-ad31-c2ad54196ed5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:47.654408 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fb1a770e-ac9b-4f7d-ad31-c2ad54196ed5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:47.656165 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fb1a770e-ac9b-4f7d-ad31-c2ad54196ed5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:47.657829 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-fb1a770e-ac9b-4f7d-ad31-c2ad54196ed5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1721 microversion: 2.20 time: 0.204011 Aug 03 10:46:47.658539 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 189/385] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:47 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:47.884676 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c77a435f-0c9f-493a-bad9-6102728b7b93 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:47.885357 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c77a435f-0c9f-493a-bad9-6102728b7b93 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:47.892045 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c77a435f-0c9f-493a-bad9-6102728b7b93 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:47.892425 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c77a435f-0c9f-493a-bad9-6102728b7b93 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:47.893895 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c77a435f-0c9f-493a-bad9-6102728b7b93 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:47.894341 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c77a435f-0c9f-493a-bad9-6102728b7b93 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:48.008065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-bf7c4f9f-38de-4ebe-abed-f658ca08a0da tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:48.009745 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-bf7c4f9f-38de-4ebe-abed-f658ca08a0da tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:48.017807 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bf7c4f9f-38de-4ebe-abed-f658ca08a0da tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:48.018992 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bf7c4f9f-38de-4ebe-abed-f658ca08a0da tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:48.019832 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bf7c4f9f-38de-4ebe-abed-f658ca08a0da tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:48.020430 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bf7c4f9f-38de-4ebe-abed-f658ca08a0da tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:48.086716 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c77a435f-0c9f-493a-bad9-6102728b7b93 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:48.097152 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c77a435f-0c9f-493a-bad9-6102728b7b93 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1444 microversion: 2.1 time: 0.217854 Aug 03 10:46:48.099243 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 197/386] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:47 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1444 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:48.118479 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ece306eb-090b-4e7b-921e-5bfe9670b647 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:48.119558 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ece306eb-090b-4e7b-921e-5bfe9670b647 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:48.128097 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ece306eb-090b-4e7b-921e-5bfe9670b647 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:48.128840 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ece306eb-090b-4e7b-921e-5bfe9670b647 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:48.129670 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ece306eb-090b-4e7b-921e-5bfe9670b647 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:48.130107 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ece306eb-090b-4e7b-921e-5bfe9670b647 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:48.239216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-bf7c4f9f-38de-4ebe-abed-f658ca08a0da tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:48.252552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-bf7c4f9f-38de-4ebe-abed-f658ca08a0da tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1371 microversion: 2.1 time: 0.247823 Aug 03 10:46:48.255323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 190/387] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:48 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:48.264009 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c01e842f-1773-43da-b65b-7cee944273cd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:48.265679 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-c01e842f-1773-43da-b65b-7cee944273cd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:48.278853 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c01e842f-1773-43da-b65b-7cee944273cd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:48.280160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c01e842f-1773-43da-b65b-7cee944273cd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:48.282040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c01e842f-1773-43da-b65b-7cee944273cd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:48.283132 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c01e842f-1773-43da-b65b-7cee944273cd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:48.374108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ece306eb-090b-4e7b-921e-5bfe9670b647 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:48.409806 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ece306eb-090b-4e7b-921e-5bfe9670b647 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1319 microversion: 2.1 time: 0.294615 Aug 03 10:46:48.432187 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 198/388] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:48 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:48.466238 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-0824436a-30a6-4f1a-9a12-140b96a71515 req-c76ca753-3efe-4839-9a6b-98d7c128e71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5895a291-434d-4b7c-85cd-0264cf37f5f3", "name": "network-vif-unplugged", "status": "completed", "tag": "971e4968-4040-4784-a0ed-4c689d9711ff"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:48.480751 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:48.491081 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-0824436a-30a6-4f1a-9a12-140b96a71515 req-c76ca753-3efe-4839-9a6b-98d7c128e71b service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:48.492359 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-0824436a-30a6-4f1a-9a12-140b96a71515 req-c76ca753-3efe-4839-9a6b-98d7c128e71b service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:48.532170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c01e842f-1773-43da-b65b-7cee944273cd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:48.536216 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-0824436a-30a6-4f1a-9a12-140b96a71515 req-c76ca753-3efe-4839-9a6b-98d7c128e71b service nova] Creating event network-vif-unplugged:971e4968-4040-4784-a0ed-4c689d9711ff for instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 on hv-cinder-85083 Aug 03 10:46:48.540967 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c01e842f-1773-43da-b65b-7cee944273cd tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1444 microversion: 2.1 time: 0.283768 Aug 03 10:46:48.542693 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 191/389] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:48 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1444 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:48.562840 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-0824436a-30a6-4f1a-9a12-140b96a71515 req-c76ca753-3efe-4839-9a6b-98d7c128e71b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127227 Aug 03 10:46:48.567095 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 199/390] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:46:48.690617 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-62b3df62-7965-49b3-8a2e-f957d4d5adf9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:48.694006 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-62b3df62-7965-49b3-8a2e-f957d4d5adf9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:48.697124 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-62b3df62-7965-49b3-8a2e-f957d4d5adf9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:48.697588 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-62b3df62-7965-49b3-8a2e-f957d4d5adf9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:48.698374 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-62b3df62-7965-49b3-8a2e-f957d4d5adf9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:48.698807 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-62b3df62-7965-49b3-8a2e-f957d4d5adf9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:48.895621 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-62b3df62-7965-49b3-8a2e-f957d4d5adf9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:48.912305 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-62b3df62-7965-49b3-8a2e-f957d4d5adf9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:48.915034 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-62b3df62-7965-49b3-8a2e-f957d4d5adf9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:48.916612 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-62b3df62-7965-49b3-8a2e-f957d4d5adf9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1721 microversion: 2.20 time: 0.236716 Aug 03 10:46:48.917360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 192/391] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:48 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:49.288351 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2f1ed1ab-7179-4600-a248-f08f4cbdfe2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:49.289023 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2f1ed1ab-7179-4600-a248-f08f4cbdfe2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:49.295894 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2f1ed1ab-7179-4600-a248-f08f4cbdfe2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:49.296344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2f1ed1ab-7179-4600-a248-f08f4cbdfe2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:49.297125 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2f1ed1ab-7179-4600-a248-f08f4cbdfe2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:49.297593 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2f1ed1ab-7179-4600-a248-f08f4cbdfe2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:49.477844 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2f1ed1ab-7179-4600-a248-f08f4cbdfe2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:49.480244 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b244e8b3-4b1f-4b47-adfa-cb6c18b9f655 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:49.485221 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b244e8b3-4b1f-4b47-adfa-cb6c18b9f655 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:49.490949 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2f1ed1ab-7179-4600-a248-f08f4cbdfe2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1371 microversion: 2.1 time: 0.207037 Aug 03 10:46:49.498497 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 200/392] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:49 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:49.499009 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b244e8b3-4b1f-4b47-adfa-cb6c18b9f655 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:49.500046 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b244e8b3-4b1f-4b47-adfa-cb6c18b9f655 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:49.501613 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b244e8b3-4b1f-4b47-adfa-cb6c18b9f655 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:49.503067 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b244e8b3-4b1f-4b47-adfa-cb6c18b9f655 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:49.696983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b244e8b3-4b1f-4b47-adfa-cb6c18b9f655 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:49.705211 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b244e8b3-4b1f-4b47-adfa-cb6c18b9f655 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1319 microversion: 2.1 time: 0.244724 Aug 03 10:46:49.705958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 193/393] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:49 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:49.945221 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ffd1c4e2-f0ee-47ac-99d5-c35f58493687 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:49.946475 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ffd1c4e2-f0ee-47ac-99d5-c35f58493687 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:49.957905 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ffd1c4e2-f0ee-47ac-99d5-c35f58493687 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:49.958203 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ffd1c4e2-f0ee-47ac-99d5-c35f58493687 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:49.959047 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ffd1c4e2-f0ee-47ac-99d5-c35f58493687 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:49.959625 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ffd1c4e2-f0ee-47ac-99d5-c35f58493687 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:50.174196 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ffd1c4e2-f0ee-47ac-99d5-c35f58493687 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:50.192827 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ffd1c4e2-f0ee-47ac-99d5-c35f58493687 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:50.196582 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ffd1c4e2-f0ee-47ac-99d5-c35f58493687 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:50.199241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ffd1c4e2-f0ee-47ac-99d5-c35f58493687 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1664 microversion: 2.20 time: 0.260245 Aug 03 10:46:50.200632 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 201/394] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:49 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1664 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:46:50.242881 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e22f11b0-e7d1-4a15-be12-2a0a3fb35fe3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9981807-3df5-431b-80c5-0e3ce67245d6"}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:50.246634 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e22f11b0-e7d1-4a15-be12-2a0a3fb35fe3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:50.255418 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e22f11b0-e7d1-4a15-be12-2a0a3fb35fe3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:50.255880 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e22f11b0-e7d1-4a15-be12-2a0a3fb35fe3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:50.256783 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e22f11b0-e7d1-4a15-be12-2a0a3fb35fe3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:50.257233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e22f11b0-e7d1-4a15-be12-2a0a3fb35fe3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:50.530718 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-87fcd103-aaf7-4f1a-9e3c-2ee54108cedb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:50.532920 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-87fcd103-aaf7-4f1a-9e3c-2ee54108cedb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:50.547841 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-87fcd103-aaf7-4f1a-9e3c-2ee54108cedb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:50.548935 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-87fcd103-aaf7-4f1a-9e3c-2ee54108cedb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:50.551130 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-87fcd103-aaf7-4f1a-9e3c-2ee54108cedb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:50.553365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-87fcd103-aaf7-4f1a-9e3c-2ee54108cedb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:50.828460 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-87fcd103-aaf7-4f1a-9e3c-2ee54108cedb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:50.842083 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-87fcd103-aaf7-4f1a-9e3c-2ee54108cedb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1371 microversion: 2.1 time: 0.319259 Aug 03 10:46:50.843367 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 202/395] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:50 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:50.853051 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-0559c57a-6608-43db-a25a-8337ce5e2126 req-3a91d286-54ee-4a6b-ac81-112183994e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b0240d-3638-48b2-a7f3-2269dd2aba05", "name": "network-vif-plugged", "status": "completed", "tag": "3a081129-4296-482f-9f57-79ce242de7a4"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:50.883620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-0559c57a-6608-43db-a25a-8337ce5e2126 req-3a91d286-54ee-4a6b-ac81-112183994e8e service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:50.886141 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-0559c57a-6608-43db-a25a-8337ce5e2126 req-3a91d286-54ee-4a6b-ac81-112183994e8e service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:50.908364 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-0559c57a-6608-43db-a25a-8337ce5e2126 req-3a91d286-54ee-4a6b-ac81-112183994e8e service nova] Creating event network-vif-plugged:3a081129-4296-482f-9f57-79ce242de7a4 for instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 on hv-cinder-85083 Aug 03 10:46:50.914909 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-0559c57a-6608-43db-a25a-8337ce5e2126 req-3a91d286-54ee-4a6b-ac81-112183994e8e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069586 Aug 03 10:46:50.915832 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 203/396] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:46:50.922151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b53d04e6-d8bd-4386-bd54-2663e9443db4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:50.923262 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b53d04e6-d8bd-4386-bd54-2663e9443db4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:50.931420 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b53d04e6-d8bd-4386-bd54-2663e9443db4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:50.931904 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b53d04e6-d8bd-4386-bd54-2663e9443db4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:50.932772 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b53d04e6-d8bd-4386-bd54-2663e9443db4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:50.933307 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b53d04e6-d8bd-4386-bd54-2663e9443db4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:50.935038 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e22f11b0-e7d1-4a15-be12-2a0a3fb35fe3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "POST /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.698100 Aug 03 10:46:50.941715 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 194/397] 10.222.0.47 () {62 vars in 1364 bytes} [Wed Aug 3 10:46:50 2022] POST /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments => generated 188 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 10:46:51.143305 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-02d72382-0d67-4c42-a48f-63dd5744c4d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:51.144945 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-02d72382-0d67-4c42-a48f-63dd5744c4d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:51.152748 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b53d04e6-d8bd-4386-bd54-2663e9443db4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:51.158218 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-02d72382-0d67-4c42-a48f-63dd5744c4d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:51.158218 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-02d72382-0d67-4c42-a48f-63dd5744c4d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:51.159123 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-02d72382-0d67-4c42-a48f-63dd5744c4d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:51.159685 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-02d72382-0d67-4c42-a48f-63dd5744c4d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:51.162854 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b53d04e6-d8bd-4386-bd54-2663e9443db4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1319 microversion: 2.1 time: 0.245692 Aug 03 10:46:51.163673 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 204/398] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:50 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:51.230560 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-02d72382-0d67-4c42-a48f-63dd5744c4d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124389) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 10:46:51.343949 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-02d72382-0d67-4c42-a48f-63dd5744c4d2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "POST /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/action" status: 202 len: 0 microversion: 2.20 time: 0.207688 Aug 03 10:46:51.349785 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 195/399] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Aug 3 10:46:51 2022] POST /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:46:51.355336 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-705e9864-9884-4b56-b6ae-4ac58eaedffd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:51.356251 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-705e9864-9884-4b56-b6ae-4ac58eaedffd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:51.367407 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-705e9864-9884-4b56-b6ae-4ac58eaedffd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:51.368104 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-705e9864-9884-4b56-b6ae-4ac58eaedffd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:51.369153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-705e9864-9884-4b56-b6ae-4ac58eaedffd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:51.370202 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-705e9864-9884-4b56-b6ae-4ac58eaedffd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:51.555233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-705e9864-9884-4b56-b6ae-4ac58eaedffd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:51.574097 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-705e9864-9884-4b56-b6ae-4ac58eaedffd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:51.577489 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-705e9864-9884-4b56-b6ae-4ac58eaedffd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:51.579730 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-705e9864-9884-4b56-b6ae-4ac58eaedffd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1750 microversion: 2.20 time: 0.228224 Aug 03 10:46:51.581079 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 205/400] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:51 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1750 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:51.732467 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-5df406f6-5d2e-41c3-98cf-305c567de239 req-f531963e-251d-47d9-924d-fdae7f540186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e1399d5-9f28-4b92-a752-a233a1652022", "tag": "ea1ca950-d067-4257-9371-6667208eda63"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:51.749319 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-5df406f6-5d2e-41c3-98cf-305c567de239 req-f531963e-251d-47d9-924d-fdae7f540186 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:51.749965 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-5df406f6-5d2e-41c3-98cf-305c567de239 req-f531963e-251d-47d9-924d-fdae7f540186 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:51.764179 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-5df406f6-5d2e-41c3-98cf-305c567de239 req-f531963e-251d-47d9-924d-fdae7f540186 service nova] Creating event network-changed:ea1ca950-d067-4257-9371-6667208eda63 for instance 7e1399d5-9f28-4b92-a752-a233a1652022 on hv-cinder-85083 Aug 03 10:46:51.771065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-5df406f6-5d2e-41c3-98cf-305c567de239 req-f531963e-251d-47d9-924d-fdae7f540186 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043128 Aug 03 10:46:51.771932 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 196/401] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:46:51.885209 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2d42e5d9-4348-44a9-a985-6f59aa7f0676 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:51.886137 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2d42e5d9-4348-44a9-a985-6f59aa7f0676 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:51.894615 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d42e5d9-4348-44a9-a985-6f59aa7f0676 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:51.895161 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d42e5d9-4348-44a9-a985-6f59aa7f0676 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:51.896014 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d42e5d9-4348-44a9-a985-6f59aa7f0676 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:51.896681 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d42e5d9-4348-44a9-a985-6f59aa7f0676 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:52.114100 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2d42e5d9-4348-44a9-a985-6f59aa7f0676 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:52.118153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:52.124734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2d42e5d9-4348-44a9-a985-6f59aa7f0676 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1371 microversion: 2.1 time: 0.245334 Aug 03 10:46:52.129522 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 206/402] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:51 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:52.193695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3d23a1d4-5b17-4c5d-8c19-a6dcffdd00b4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:52.194977 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3d23a1d4-5b17-4c5d-8c19-a6dcffdd00b4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:52.202528 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3d23a1d4-5b17-4c5d-8c19-a6dcffdd00b4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:52.203047 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3d23a1d4-5b17-4c5d-8c19-a6dcffdd00b4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:52.204055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3d23a1d4-5b17-4c5d-8c19-a6dcffdd00b4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:52.204558 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3d23a1d4-5b17-4c5d-8c19-a6dcffdd00b4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:52.364192 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3d23a1d4-5b17-4c5d-8c19-a6dcffdd00b4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:52.373325 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3d23a1d4-5b17-4c5d-8c19-a6dcffdd00b4 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1319 microversion: 2.1 time: 0.184485 Aug 03 10:46:52.373960 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 197/403] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:52 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:52.607514 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b1dfa265-c0a0-42d7-b170-1e37731a0455 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:52.608423 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b1dfa265-c0a0-42d7-b170-1e37731a0455 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:52.616335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b1dfa265-c0a0-42d7-b170-1e37731a0455 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:52.617230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b1dfa265-c0a0-42d7-b170-1e37731a0455 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:52.618124 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b1dfa265-c0a0-42d7-b170-1e37731a0455 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:52.618761 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b1dfa265-c0a0-42d7-b170-1e37731a0455 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:52.818166 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b1dfa265-c0a0-42d7-b170-1e37731a0455 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:52.837317 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b1dfa265-c0a0-42d7-b170-1e37731a0455 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:52.840263 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b1dfa265-c0a0-42d7-b170-1e37731a0455 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:52.842404 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b1dfa265-c0a0-42d7-b170-1e37731a0455 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1750 microversion: 2.20 time: 0.239160 Aug 03 10:46:52.842987 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 207/404] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:52 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1750 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:46:53.160588 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b6eb9460-c011-4f92-8952-9fb27705fd65 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:53.161303 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b6eb9460-c011-4f92-8952-9fb27705fd65 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:53.169224 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b6eb9460-c011-4f92-8952-9fb27705fd65 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:53.169544 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b6eb9460-c011-4f92-8952-9fb27705fd65 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:53.170390 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b6eb9460-c011-4f92-8952-9fb27705fd65 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:53.170824 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b6eb9460-c011-4f92-8952-9fb27705fd65 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:53.349772 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b6eb9460-c011-4f92-8952-9fb27705fd65 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:53.357782 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b6eb9460-c011-4f92-8952-9fb27705fd65 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1371 microversion: 2.1 time: 0.201631 Aug 03 10:46:53.358370 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 198/405] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:53 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:53.394818 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7b435cf8-c6be-431c-b2ea-a063b0137bb7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:53.395445 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7b435cf8-c6be-431c-b2ea-a063b0137bb7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:53.401936 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7b435cf8-c6be-431c-b2ea-a063b0137bb7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:53.402311 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7b435cf8-c6be-431c-b2ea-a063b0137bb7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:53.403097 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7b435cf8-c6be-431c-b2ea-a063b0137bb7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:53.403540 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7b435cf8-c6be-431c-b2ea-a063b0137bb7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:53.572596 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7b435cf8-c6be-431c-b2ea-a063b0137bb7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:53.583008 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7b435cf8-c6be-431c-b2ea-a063b0137bb7 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1319 microversion: 2.1 time: 0.192033 Aug 03 10:46:53.583594 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 208/406] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:53 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:53.873146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-366bff97-c499-4c71-b79c-f3594901b007 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:53.873785 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-366bff97-c499-4c71-b79c-f3594901b007 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:53.880731 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-366bff97-c499-4c71-b79c-f3594901b007 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:53.881164 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-366bff97-c499-4c71-b79c-f3594901b007 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:53.882040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-366bff97-c499-4c71-b79c-f3594901b007 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:53.882473 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-366bff97-c499-4c71-b79c-f3594901b007 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:54.050842 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-366bff97-c499-4c71-b79c-f3594901b007 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:54.062314 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-366bff97-c499-4c71-b79c-f3594901b007 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:54.063962 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-366bff97-c499-4c71-b79c-f3594901b007 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:54.066365 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-366bff97-c499-4c71-b79c-f3594901b007 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1750 microversion: 2.20 time: 0.197085 Aug 03 10:46:54.069507 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 199/407] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:53 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1750 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:54.382680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-494cd4db-c8ad-41dc-a25a-d26c48def13c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:54.383770 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-494cd4db-c8ad-41dc-a25a-d26c48def13c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:54.393404 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-494cd4db-c8ad-41dc-a25a-d26c48def13c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:54.394266 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-494cd4db-c8ad-41dc-a25a-d26c48def13c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:54.395709 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-494cd4db-c8ad-41dc-a25a-d26c48def13c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:54.396525 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-494cd4db-c8ad-41dc-a25a-d26c48def13c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:54.562079 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-494cd4db-c8ad-41dc-a25a-d26c48def13c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:54.571957 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-494cd4db-c8ad-41dc-a25a-d26c48def13c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1371 microversion: 2.1 time: 0.196170 Aug 03 10:46:54.572551 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 209/408] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:54 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:54.612391 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6df4367f-a8ef-4c81-8b3d-f880cf39c5df tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:54.613043 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6df4367f-a8ef-4c81-8b3d-f880cf39c5df tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:54.624729 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6df4367f-a8ef-4c81-8b3d-f880cf39c5df tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:54.625209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6df4367f-a8ef-4c81-8b3d-f880cf39c5df tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:54.626269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6df4367f-a8ef-4c81-8b3d-f880cf39c5df tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:54.626730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6df4367f-a8ef-4c81-8b3d-f880cf39c5df tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:54.784550 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-6df4367f-a8ef-4c81-8b3d-f880cf39c5df tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:54.807144 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-6df4367f-a8ef-4c81-8b3d-f880cf39c5df tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1319 microversion: 2.1 time: 0.198789 Aug 03 10:46:54.808175 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 200/409] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:54 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:46:55.093690 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-378bbab6-edd1-48da-a1d6-52f90789d895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:55.094610 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-378bbab6-edd1-48da-a1d6-52f90789d895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:55.102985 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-378bbab6-edd1-48da-a1d6-52f90789d895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:55.103484 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-378bbab6-edd1-48da-a1d6-52f90789d895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:55.104592 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-378bbab6-edd1-48da-a1d6-52f90789d895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:55.105357 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-378bbab6-edd1-48da-a1d6-52f90789d895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:55.256294 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-378bbab6-edd1-48da-a1d6-52f90789d895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:55.269347 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-378bbab6-edd1-48da-a1d6-52f90789d895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:55.272417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-378bbab6-edd1-48da-a1d6-52f90789d895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:55.274249 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-378bbab6-edd1-48da-a1d6-52f90789d895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1752 microversion: 2.20 time: 0.188142 Aug 03 10:46:55.274918 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 210/410] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:55 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1752 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:55.592806 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-945ae816-eb08-4d5e-b14b-c33f7f02a150 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:55.593410 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-945ae816-eb08-4d5e-b14b-c33f7f02a150 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:55.599404 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-945ae816-eb08-4d5e-b14b-c33f7f02a150 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:55.599853 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-945ae816-eb08-4d5e-b14b-c33f7f02a150 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:55.600602 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-945ae816-eb08-4d5e-b14b-c33f7f02a150 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:55.601029 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-945ae816-eb08-4d5e-b14b-c33f7f02a150 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:55.730821 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-945ae816-eb08-4d5e-b14b-c33f7f02a150 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:55.733263 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:46:55.741977 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-945ae816-eb08-4d5e-b14b-c33f7f02a150 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1566 microversion: 2.1 time: 0.152806 Aug 03 10:46:55.742565 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 201/411] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:55 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:55.763554 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b748f5c8-5e2c-441e-9695-93fadec70fea tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:55.764146 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b748f5c8-5e2c-441e-9695-93fadec70fea tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:55.770599 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b748f5c8-5e2c-441e-9695-93fadec70fea tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:55.771073 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b748f5c8-5e2c-441e-9695-93fadec70fea tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:55.771848 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b748f5c8-5e2c-441e-9695-93fadec70fea tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:55.772280 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b748f5c8-5e2c-441e-9695-93fadec70fea tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:55.848878 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3296183e-c1e2-467b-a009-eb4e9f13d865 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:55.849429 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3296183e-c1e2-467b-a009-eb4e9f13d865 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:55.857379 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3296183e-c1e2-467b-a009-eb4e9f13d865 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:55.858217 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3296183e-c1e2-467b-a009-eb4e9f13d865 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:55.859479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3296183e-c1e2-467b-a009-eb4e9f13d865 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:55.860410 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3296183e-c1e2-467b-a009-eb4e9f13d865 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:55.875874 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b748f5c8-5e2c-441e-9695-93fadec70fea tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116255 Aug 03 10:46:55.876835 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 211/412] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 3 10:46:55 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:46:56.253828 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-d4fb5d1b-1321-4c57-bad1-f46f687fd065 req-1db4d826-e685-466c-9a7d-9d1f7f45b0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476109cf-f3fe-42cd-b1dd-aadbe1c56a52", "name": "network-vif-plugged", "status": "completed", "tag": "075ed4cf-bf99-45c6-b995-b90ac6821b48"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:56.270666 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-d4fb5d1b-1321-4c57-bad1-f46f687fd065 req-1db4d826-e685-466c-9a7d-9d1f7f45b0b3 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:56.271360 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-d4fb5d1b-1321-4c57-bad1-f46f687fd065 req-1db4d826-e685-466c-9a7d-9d1f7f45b0b3 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:56.303177 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-d4fb5d1b-1321-4c57-bad1-f46f687fd065 req-1db4d826-e685-466c-9a7d-9d1f7f45b0b3 service nova] Creating event network-vif-plugged:075ed4cf-bf99-45c6-b995-b90ac6821b48 for instance 476109cf-f3fe-42cd-b1dd-aadbe1c56a52 on hv-cinder-85083 Aug 03 10:46:56.315587 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-d4fb5d1b-1321-4c57-bad1-f46f687fd065 req-1db4d826-e685-466c-9a7d-9d1f7f45b0b3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069321 Aug 03 10:46:56.317025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 212/413] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:46:56.324171 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ef7a02a4-de0c-4375-ba3c-361b27d435da tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:56.325701 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ef7a02a4-de0c-4375-ba3c-361b27d435da tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:56.340922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ef7a02a4-de0c-4375-ba3c-361b27d435da tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:56.341742 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ef7a02a4-de0c-4375-ba3c-361b27d435da tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:56.342762 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ef7a02a4-de0c-4375-ba3c-361b27d435da tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:56.343445 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ef7a02a4-de0c-4375-ba3c-361b27d435da tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:56.416791 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3296183e-c1e2-467b-a009-eb4e9f13d865 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:56.425947 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3296183e-c1e2-467b-a009-eb4e9f13d865 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1319 microversion: 2.1 time: 0.586754 Aug 03 10:46:56.426544 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 202/414] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:55 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1319 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:56.675263 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ef7a02a4-de0c-4375-ba3c-361b27d435da tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:56.700054 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ef7a02a4-de0c-4375-ba3c-361b27d435da tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:56.701621 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ef7a02a4-de0c-4375-ba3c-361b27d435da tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:56.705224 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ef7a02a4-de0c-4375-ba3c-361b27d435da tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.386609 Aug 03 10:46:56.706134 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 213/415] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:56 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:57.476972 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-867b2c40-78c0-4858-a3ce-e01851f50464 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:57.479114 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-867b2c40-78c0-4858-a3ce-e01851f50464 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:57.491495 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-867b2c40-78c0-4858-a3ce-e01851f50464 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:57.492318 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-867b2c40-78c0-4858-a3ce-e01851f50464 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:57.493808 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-867b2c40-78c0-4858-a3ce-e01851f50464 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:57.494614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-867b2c40-78c0-4858-a3ce-e01851f50464 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:57.751393 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f698a9cb-4ab3-43b2-9c4b-45780e830367 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:57.752172 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f698a9cb-4ab3-43b2-9c4b-45780e830367 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:57.760483 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f698a9cb-4ab3-43b2-9c4b-45780e830367 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:57.761050 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f698a9cb-4ab3-43b2-9c4b-45780e830367 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:57.761812 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-867b2c40-78c0-4858-a3ce-e01851f50464 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:57.762015 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f698a9cb-4ab3-43b2-9c4b-45780e830367 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:57.762660 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f698a9cb-4ab3-43b2-9c4b-45780e830367 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:57.770877 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-867b2c40-78c0-4858-a3ce-e01851f50464 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1319 microversion: 2.1 time: 0.301606 Aug 03 10:46:57.771469 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 203/416] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:57 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:57.776310 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-9f6adb3b-d5d9-49b5-8020-35866f34cac1 req-d00a96e1-512b-416b-b5be-7872c864ec0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b0240d-3638-48b2-a7f3-2269dd2aba05", "tag": "3a081129-4296-482f-9f57-79ce242de7a4"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:46:57.791250 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-9f6adb3b-d5d9-49b5-8020-35866f34cac1 req-d00a96e1-512b-416b-b5be-7872c864ec0b service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:57.791711 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-9f6adb3b-d5d9-49b5-8020-35866f34cac1 req-d00a96e1-512b-416b-b5be-7872c864ec0b service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:57.805677 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-9f6adb3b-d5d9-49b5-8020-35866f34cac1 req-d00a96e1-512b-416b-b5be-7872c864ec0b service nova] Creating event network-changed:3a081129-4296-482f-9f57-79ce242de7a4 for instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 on hv-cinder-85083 Aug 03 10:46:57.811309 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-9f6adb3b-d5d9-49b5-8020-35866f34cac1 req-d00a96e1-512b-416b-b5be-7872c864ec0b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038418 Aug 03 10:46:57.812183 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 204/417] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:46:58.185843 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f698a9cb-4ab3-43b2-9c4b-45780e830367 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:58.199360 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f698a9cb-4ab3-43b2-9c4b-45780e830367 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:58.201247 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f698a9cb-4ab3-43b2-9c4b-45780e830367 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:58.202794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f698a9cb-4ab3-43b2-9c4b-45780e830367 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.457435 Aug 03 10:46:58.203902 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 214/418] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:57 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:46:58.795767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-850a8e9b-b1d8-4e45-90da-48ae5230efee tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:58.796403 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-850a8e9b-b1d8-4e45-90da-48ae5230efee tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:58.803761 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-850a8e9b-b1d8-4e45-90da-48ae5230efee tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:58.804211 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-850a8e9b-b1d8-4e45-90da-48ae5230efee tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:58.804995 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-850a8e9b-b1d8-4e45-90da-48ae5230efee tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:58.805424 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-850a8e9b-b1d8-4e45-90da-48ae5230efee tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:58.978590 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-850a8e9b-b1d8-4e45-90da-48ae5230efee tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:58.992621 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-850a8e9b-b1d8-4e45-90da-48ae5230efee tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1509 microversion: 2.1 time: 0.201369 Aug 03 10:46:58.993698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 205/419] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:46:58 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:46:59.244835 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3d8e039e-dab7-40ff-a524-763dc828fd0e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:46:59.247107 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3d8e039e-dab7-40ff-a524-763dc828fd0e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:46:59.265282 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3d8e039e-dab7-40ff-a524-763dc828fd0e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:59.266662 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3d8e039e-dab7-40ff-a524-763dc828fd0e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:59.279268 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3d8e039e-dab7-40ff-a524-763dc828fd0e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:46:59.281071 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3d8e039e-dab7-40ff-a524-763dc828fd0e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:46:59.630186 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3d8e039e-dab7-40ff-a524-763dc828fd0e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:59.639408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3d8e039e-dab7-40ff-a524-763dc828fd0e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:59.641066 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3d8e039e-dab7-40ff-a524-763dc828fd0e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:46:59.642468 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3d8e039e-dab7-40ff-a524-763dc828fd0e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.409588 Aug 03 10:46:59.660525 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 215/420] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:46:59 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:00.692714 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-f6bbfebc-a5e2-4b8d-a4b8-450ad2746742 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:00.693611 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-f6bbfebc-a5e2-4b8d-a4b8-450ad2746742 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:00.712823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f6bbfebc-a5e2-4b8d-a4b8-450ad2746742 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:00.713712 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f6bbfebc-a5e2-4b8d-a4b8-450ad2746742 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:00.716358 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f6bbfebc-a5e2-4b8d-a4b8-450ad2746742 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:00.716994 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f6bbfebc-a5e2-4b8d-a4b8-450ad2746742 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:01.048832 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f6bbfebc-a5e2-4b8d-a4b8-450ad2746742 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:01.063979 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f6bbfebc-a5e2-4b8d-a4b8-450ad2746742 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:01.067261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f6bbfebc-a5e2-4b8d-a4b8-450ad2746742 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:01.072151 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-f6bbfebc-a5e2-4b8d-a4b8-450ad2746742 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.390952 Aug 03 10:47:01.074223 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 206/421] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:00 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:02.121982 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1a60a747-7b16-4633-98d8-a5d114a981c3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:02.123972 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1a60a747-7b16-4633-98d8-a5d114a981c3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:02.133742 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1a60a747-7b16-4633-98d8-a5d114a981c3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:02.134291 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1a60a747-7b16-4633-98d8-a5d114a981c3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:02.135363 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1a60a747-7b16-4633-98d8-a5d114a981c3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:02.137507 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1a60a747-7b16-4633-98d8-a5d114a981c3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:02.364104 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1a60a747-7b16-4633-98d8-a5d114a981c3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:02.380321 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1a60a747-7b16-4633-98d8-a5d114a981c3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:02.383753 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1a60a747-7b16-4633-98d8-a5d114a981c3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:02.386773 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1a60a747-7b16-4633-98d8-a5d114a981c3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.272490 Aug 03 10:47:02.388023 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 216/422] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:02 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:03.431513 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3c6df3d3-ffe0-42e5-bb22-513f375280a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:03.432525 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3c6df3d3-ffe0-42e5-bb22-513f375280a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:03.445128 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3c6df3d3-ffe0-42e5-bb22-513f375280a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:03.446202 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3c6df3d3-ffe0-42e5-bb22-513f375280a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:03.447551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3c6df3d3-ffe0-42e5-bb22-513f375280a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:03.448086 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3c6df3d3-ffe0-42e5-bb22-513f375280a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:03.614068 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3c6df3d3-ffe0-42e5-bb22-513f375280a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:03.623703 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3c6df3d3-ffe0-42e5-bb22-513f375280a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:03.625247 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3c6df3d3-ffe0-42e5-bb22-513f375280a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:03.626501 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3c6df3d3-ffe0-42e5-bb22-513f375280a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.202498 Aug 03 10:47:03.627081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 207/423] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:03 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:04.650604 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-92ac9d4b-60ce-4016-96f5-017809d8f9e8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:04.652575 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-92ac9d4b-60ce-4016-96f5-017809d8f9e8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:04.664609 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-92ac9d4b-60ce-4016-96f5-017809d8f9e8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:04.665797 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-92ac9d4b-60ce-4016-96f5-017809d8f9e8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:04.667167 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-92ac9d4b-60ce-4016-96f5-017809d8f9e8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:04.667965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-92ac9d4b-60ce-4016-96f5-017809d8f9e8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:04.873763 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-92ac9d4b-60ce-4016-96f5-017809d8f9e8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:04.892000 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-92ac9d4b-60ce-4016-96f5-017809d8f9e8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:04.895496 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-92ac9d4b-60ce-4016-96f5-017809d8f9e8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:04.897881 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-92ac9d4b-60ce-4016-96f5-017809d8f9e8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.250963 Aug 03 10:47:04.898950 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 217/424] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:04 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:47:05.938437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-32168f30-3c41-4597-ab9a-a71b68ca220f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:05.942098 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-32168f30-3c41-4597-ab9a-a71b68ca220f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:05.953398 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:47:05.957690 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-32168f30-3c41-4597-ab9a-a71b68ca220f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:05.959438 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-32168f30-3c41-4597-ab9a-a71b68ca220f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:05.961399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-32168f30-3c41-4597-ab9a-a71b68ca220f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:05.962348 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-32168f30-3c41-4597-ab9a-a71b68ca220f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:06.218170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-32168f30-3c41-4597-ab9a-a71b68ca220f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:06.228123 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-32168f30-3c41-4597-ab9a-a71b68ca220f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:06.229729 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-32168f30-3c41-4597-ab9a-a71b68ca220f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:06.230966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-32168f30-3c41-4597-ab9a-a71b68ca220f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.299894 Aug 03 10:47:06.231535 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 208/425] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:05 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:07.270401 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a1b7ab55-4c98-42c1-9832-f7ad1734df5f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:07.271676 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a1b7ab55-4c98-42c1-9832-f7ad1734df5f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:07.284006 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a1b7ab55-4c98-42c1-9832-f7ad1734df5f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:07.284667 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a1b7ab55-4c98-42c1-9832-f7ad1734df5f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:07.285626 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a1b7ab55-4c98-42c1-9832-f7ad1734df5f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:07.286209 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a1b7ab55-4c98-42c1-9832-f7ad1734df5f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:07.460244 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a1b7ab55-4c98-42c1-9832-f7ad1734df5f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:07.474621 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a1b7ab55-4c98-42c1-9832-f7ad1734df5f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:07.476561 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a1b7ab55-4c98-42c1-9832-f7ad1734df5f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:07.478633 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a1b7ab55-4c98-42c1-9832-f7ad1734df5f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.213264 Aug 03 10:47:07.479657 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 218/426] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:07 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:08.507980 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d0f2994e-8977-481a-8e04-27be654ef875 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:08.508676 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d0f2994e-8977-481a-8e04-27be654ef875 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:08.516499 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d0f2994e-8977-481a-8e04-27be654ef875 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:08.517315 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d0f2994e-8977-481a-8e04-27be654ef875 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:08.518332 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d0f2994e-8977-481a-8e04-27be654ef875 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:08.519039 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d0f2994e-8977-481a-8e04-27be654ef875 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:08.705697 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d0f2994e-8977-481a-8e04-27be654ef875 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:08.719906 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d0f2994e-8977-481a-8e04-27be654ef875 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:08.727367 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d0f2994e-8977-481a-8e04-27be654ef875 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:08.728682 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d0f2994e-8977-481a-8e04-27be654ef875 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.225249 Aug 03 10:47:08.729499 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 209/427] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:08 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:09.752746 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b7a9c3e3-314c-483c-bf85-fe329552c903 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:09.753234 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b7a9c3e3-314c-483c-bf85-fe329552c903 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:09.766427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b7a9c3e3-314c-483c-bf85-fe329552c903 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:09.767244 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b7a9c3e3-314c-483c-bf85-fe329552c903 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:09.771498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b7a9c3e3-314c-483c-bf85-fe329552c903 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:09.772063 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b7a9c3e3-314c-483c-bf85-fe329552c903 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:09.925150 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b7a9c3e3-314c-483c-bf85-fe329552c903 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:09.936479 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b7a9c3e3-314c-483c-bf85-fe329552c903 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:09.938195 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b7a9c3e3-314c-483c-bf85-fe329552c903 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:09.940015 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b7a9c3e3-314c-483c-bf85-fe329552c903 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.191181 Aug 03 10:47:09.941499 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 219/428] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:09 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:10.588623 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:47:10.588873 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Wed Aug 3 10:47:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:47:10.965228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-89e2b0ac-83b6-4437-9b1d-e8e2613d708f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:10.965899 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-89e2b0ac-83b6-4437-9b1d-e8e2613d708f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:10.972750 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-89e2b0ac-83b6-4437-9b1d-e8e2613d708f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:10.973202 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-89e2b0ac-83b6-4437-9b1d-e8e2613d708f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:10.974132 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-89e2b0ac-83b6-4437-9b1d-e8e2613d708f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:10.974571 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-89e2b0ac-83b6-4437-9b1d-e8e2613d708f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:11.139087 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-89e2b0ac-83b6-4437-9b1d-e8e2613d708f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:11.149810 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-89e2b0ac-83b6-4437-9b1d-e8e2613d708f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:11.151328 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-89e2b0ac-83b6-4437-9b1d-e8e2613d708f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:11.154941 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-89e2b0ac-83b6-4437-9b1d-e8e2613d708f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.194275 Aug 03 10:47:11.175111 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 210/429] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:10 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:12.183461 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-001e2ad8-9e86-4551-adc0-1825de7c5e80 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:12.184699 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-001e2ad8-9e86-4551-adc0-1825de7c5e80 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:12.198196 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-001e2ad8-9e86-4551-adc0-1825de7c5e80 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:12.198829 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-001e2ad8-9e86-4551-adc0-1825de7c5e80 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:12.199625 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-001e2ad8-9e86-4551-adc0-1825de7c5e80 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:12.200067 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-001e2ad8-9e86-4551-adc0-1825de7c5e80 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:12.375088 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-001e2ad8-9e86-4551-adc0-1825de7c5e80 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:12.384677 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-001e2ad8-9e86-4551-adc0-1825de7c5e80 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:12.386240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-001e2ad8-9e86-4551-adc0-1825de7c5e80 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:12.387440 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-001e2ad8-9e86-4551-adc0-1825de7c5e80 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.208206 Aug 03 10:47:12.388052 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 220/430] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:12 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:13.412312 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e7fdb665-8d7c-42f4-a59c-bbd0aabac915 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:13.413028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e7fdb665-8d7c-42f4-a59c-bbd0aabac915 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:13.420691 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e7fdb665-8d7c-42f4-a59c-bbd0aabac915 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:13.421034 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e7fdb665-8d7c-42f4-a59c-bbd0aabac915 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:13.421816 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e7fdb665-8d7c-42f4-a59c-bbd0aabac915 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:13.422242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e7fdb665-8d7c-42f4-a59c-bbd0aabac915 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:13.551430 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e7fdb665-8d7c-42f4-a59c-bbd0aabac915 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:13.559809 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e7fdb665-8d7c-42f4-a59c-bbd0aabac915 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:13.561359 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e7fdb665-8d7c-42f4-a59c-bbd0aabac915 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:13.562576 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e7fdb665-8d7c-42f4-a59c-bbd0aabac915 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.155200 Aug 03 10:47:13.563143 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 211/431] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:13 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:47:14.586219 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-26a32bab-2c6f-4d57-b93c-08ca908020dd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:14.586820 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-26a32bab-2c6f-4d57-b93c-08ca908020dd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:14.592821 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26a32bab-2c6f-4d57-b93c-08ca908020dd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:14.593258 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26a32bab-2c6f-4d57-b93c-08ca908020dd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:14.594046 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26a32bab-2c6f-4d57-b93c-08ca908020dd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:14.594471 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26a32bab-2c6f-4d57-b93c-08ca908020dd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:14.736302 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-26a32bab-2c6f-4d57-b93c-08ca908020dd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:14.745488 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-26a32bab-2c6f-4d57-b93c-08ca908020dd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:14.747004 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-26a32bab-2c6f-4d57-b93c-08ca908020dd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:14.748143 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-26a32bab-2c6f-4d57-b93c-08ca908020dd tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.166584 Aug 03 10:47:14.748687 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 221/432] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:14 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:15.771678 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5e49eec2-cb65-4021-afc9-7eb585987244 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:15.772251 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-5e49eec2-cb65-4021-afc9-7eb585987244 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:15.778769 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5e49eec2-cb65-4021-afc9-7eb585987244 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:15.779216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5e49eec2-cb65-4021-afc9-7eb585987244 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:15.779986 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5e49eec2-cb65-4021-afc9-7eb585987244 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:15.780418 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5e49eec2-cb65-4021-afc9-7eb585987244 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:15.923002 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5e49eec2-cb65-4021-afc9-7eb585987244 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:15.932227 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5e49eec2-cb65-4021-afc9-7eb585987244 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:15.933815 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5e49eec2-cb65-4021-afc9-7eb585987244 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:15.935080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5e49eec2-cb65-4021-afc9-7eb585987244 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.168139 Aug 03 10:47:15.935644 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 212/433] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:15 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:16.959380 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ee14fc6b-cdda-40b0-b9bc-38e1921f5cc3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:16.960030 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ee14fc6b-cdda-40b0-b9bc-38e1921f5cc3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:16.968704 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee14fc6b-cdda-40b0-b9bc-38e1921f5cc3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:16.969149 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee14fc6b-cdda-40b0-b9bc-38e1921f5cc3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:16.969955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee14fc6b-cdda-40b0-b9bc-38e1921f5cc3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:16.970386 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee14fc6b-cdda-40b0-b9bc-38e1921f5cc3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:17.113206 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ee14fc6b-cdda-40b0-b9bc-38e1921f5cc3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:17.124183 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ee14fc6b-cdda-40b0-b9bc-38e1921f5cc3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:17.126642 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ee14fc6b-cdda-40b0-b9bc-38e1921f5cc3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:17.128900 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ee14fc6b-cdda-40b0-b9bc-38e1921f5cc3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.174258 Aug 03 10:47:17.129510 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 222/434] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:16 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:18.153321 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5d605f01-fc36-4aa7-95d7-2589ed9126b7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:18.153959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-5d605f01-fc36-4aa7-95d7-2589ed9126b7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:18.161020 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5d605f01-fc36-4aa7-95d7-2589ed9126b7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:18.161491 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5d605f01-fc36-4aa7-95d7-2589ed9126b7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:18.162310 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5d605f01-fc36-4aa7-95d7-2589ed9126b7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:18.162740 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5d605f01-fc36-4aa7-95d7-2589ed9126b7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:18.302358 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5d605f01-fc36-4aa7-95d7-2589ed9126b7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:18.311454 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5d605f01-fc36-4aa7-95d7-2589ed9126b7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:18.312908 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5d605f01-fc36-4aa7-95d7-2589ed9126b7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:18.314098 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5d605f01-fc36-4aa7-95d7-2589ed9126b7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.164851 Aug 03 10:47:18.314650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 213/435] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:18 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:18.340730 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fd714dcc-3313-486c-9101-02bd314b7c52 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:18.341447 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fd714dcc-3313-486c-9101-02bd314b7c52 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:18.347561 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fd714dcc-3313-486c-9101-02bd314b7c52 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:18.348018 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fd714dcc-3313-486c-9101-02bd314b7c52 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:18.348788 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fd714dcc-3313-486c-9101-02bd314b7c52 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:18.349225 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fd714dcc-3313-486c-9101-02bd314b7c52 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:18.477846 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-fd714dcc-3313-486c-9101-02bd314b7c52 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lazy-loading 'services' on Instance uuid fbb281c5-ccf1-4de2-99fb-5201efd51b09 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:47:18.583510 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:47:18.595915 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fd714dcc-3313-486c-9101-02bd314b7c52 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/os-volume_attachments/c746fdc9-251b-43e4-8dfa-420c4a3273aa" status: 202 len: 0 microversion: 2.1 time: 0.259043 Aug 03 10:47:18.597066 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 223/436] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 3 10:47:18 2022] DELETE /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/os-volume_attachments/c746fdc9-251b-43e4-8dfa-420c4a3273aa => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:47:19.168654 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-83d0af8a-fa27-4c44-a46f-bd0d9b94c32c tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c980f0a4-8bd4-42b7-a4d8-e8442ebf73f7", "device": "/dev/sdb"}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:47:19.171731 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-83d0af8a-fa27-4c44-a46f-bd0d9b94c32c tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:19.178281 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-83d0af8a-fa27-4c44-a46f-bd0d9b94c32c tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:19.178719 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-83d0af8a-fa27-4c44-a46f-bd0d9b94c32c tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:19.179475 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-83d0af8a-fa27-4c44-a46f-bd0d9b94c32c tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:19.179902 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-83d0af8a-fa27-4c44-a46f-bd0d9b94c32c tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:19.345699 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9819e48a-1cbe-4505-b3f7-591e9889fd58 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:19.345699 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9819e48a-1cbe-4505-b3f7-591e9889fd58 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:19.345699 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=50 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:47:19.347257 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9819e48a-1cbe-4505-b3f7-591e9889fd58 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:19.347734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9819e48a-1cbe-4505-b3f7-591e9889fd58 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:19.348497 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9819e48a-1cbe-4505-b3f7-591e9889fd58 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:19.348927 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9819e48a-1cbe-4505-b3f7-591e9889fd58 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:19.482567 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9819e48a-1cbe-4505-b3f7-591e9889fd58 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:19.494379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9819e48a-1cbe-4505-b3f7-591e9889fd58 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:19.495864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9819e48a-1cbe-4505-b3f7-591e9889fd58 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:19.497015 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9819e48a-1cbe-4505-b3f7-591e9889fd58 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.162503 Aug 03 10:47:19.497577 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 224/437] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:19 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:47:20.520374 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b1aa7524-1a2e-44e0-a2c3-26ef06bd7f0a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:20.521041 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b1aa7524-1a2e-44e0-a2c3-26ef06bd7f0a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:20.527232 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b1aa7524-1a2e-44e0-a2c3-26ef06bd7f0a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:20.527692 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b1aa7524-1a2e-44e0-a2c3-26ef06bd7f0a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:20.528493 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b1aa7524-1a2e-44e0-a2c3-26ef06bd7f0a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:20.528928 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b1aa7524-1a2e-44e0-a2c3-26ef06bd7f0a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:20.696042 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b1aa7524-1a2e-44e0-a2c3-26ef06bd7f0a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:20.705183 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b1aa7524-1a2e-44e0-a2c3-26ef06bd7f0a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:20.706735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b1aa7524-1a2e-44e0-a2c3-26ef06bd7f0a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:20.707927 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b1aa7524-1a2e-44e0-a2c3-26ef06bd7f0a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.191606 Aug 03 10:47:20.708742 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 225/438] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:20 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:47:20.717179 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-83d0af8a-fa27-4c44-a46f-bd0d9b94c32c tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "POST /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.552202 Aug 03 10:47:20.718920 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 214/439] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 3 10:47:19 2022] POST /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52/os-volume_attachments => generated 194 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:47:21.732725 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-11f4823c-7d30-4d42-a514-ba13dff4af93 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:21.733445 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-11f4823c-7d30-4d42-a514-ba13dff4af93 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:21.740872 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11f4823c-7d30-4d42-a514-ba13dff4af93 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:21.741349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11f4823c-7d30-4d42-a514-ba13dff4af93 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:21.742250 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11f4823c-7d30-4d42-a514-ba13dff4af93 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:21.742732 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11f4823c-7d30-4d42-a514-ba13dff4af93 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:21.898961 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-11f4823c-7d30-4d42-a514-ba13dff4af93 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:21.908656 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-11f4823c-7d30-4d42-a514-ba13dff4af93 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:21.910808 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-11f4823c-7d30-4d42-a514-ba13dff4af93 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:21.912019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-11f4823c-7d30-4d42-a514-ba13dff4af93 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.183499 Aug 03 10:47:21.912849 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 226/440] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:21 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:21.923963 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-602f47bf-4be2-4ddc-bc79-11e585b9c10f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:47:21.939483 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-602f47bf-4be2-4ddc-bc79-11e585b9c10f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:21.939832 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-602f47bf-4be2-4ddc-bc79-11e585b9c10f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:21.977135 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-602f47bf-4be2-4ddc-bc79-11e585b9c10f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Going to try to stop instance {{(pid=124389) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 10:47:22.027081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-602f47bf-4be2-4ddc-bc79-11e585b9c10f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "POST /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/action" status: 202 len: 0 microversion: 2.1 time: 0.112204 Aug 03 10:47:22.027803 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 215/441] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 3 10:47:21 2022] POST /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 10:47:22.036822 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a57b5eae-048e-45bf-9c61-54d98dd13abe tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:22.037438 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a57b5eae-048e-45bf-9c61-54d98dd13abe tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:22.044042 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a57b5eae-048e-45bf-9c61-54d98dd13abe tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:22.044487 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a57b5eae-048e-45bf-9c61-54d98dd13abe tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:22.045321 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a57b5eae-048e-45bf-9c61-54d98dd13abe tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:22.045767 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a57b5eae-048e-45bf-9c61-54d98dd13abe tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:22.209378 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a57b5eae-048e-45bf-9c61-54d98dd13abe tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:22.218148 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a57b5eae-048e-45bf-9c61-54d98dd13abe tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1678 microversion: 2.1 time: 0.185272 Aug 03 10:47:22.219115 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 227/442] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:22 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:22.325275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-13692180-5b73-483b-87d5-247ba0c6289f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:22.325764 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-13692180-5b73-483b-87d5-247ba0c6289f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:22.332462 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-13692180-5b73-483b-87d5-247ba0c6289f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:22.332907 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-13692180-5b73-483b-87d5-247ba0c6289f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:22.333699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-13692180-5b73-483b-87d5-247ba0c6289f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:22.334184 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-13692180-5b73-483b-87d5-247ba0c6289f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:22.357849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-13692180-5b73-483b-87d5-247ba0c6289f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570/ips" status: 200 len: 150 microversion: 2.1 time: 0.036954 Aug 03 10:47:22.358437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 216/443] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 3 10:47:22 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:47:22.371046 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b60f5672-ba28-4e90-b44d-5bc6d4328880 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "739d4b15-2893-4360-9016-6c8263230878"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:47:22.373512 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b60f5672-ba28-4e90-b44d-5bc6d4328880 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:22.382000 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b60f5672-ba28-4e90-b44d-5bc6d4328880 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:22.382637 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b60f5672-ba28-4e90-b44d-5bc6d4328880 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:22.383417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b60f5672-ba28-4e90-b44d-5bc6d4328880 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:22.383849 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b60f5672-ba28-4e90-b44d-5bc6d4328880 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:22.470080 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-b60f5672-ba28-4e90-b44d-5bc6d4328880 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] HTTP exception thrown: Invalid volume: volume 739d4b15-2893-4360-9016-6c8263230878 is already attached to instances: b6a399a7-91eb-41c8-b408-c5df154a36cc Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b60f5672-ba28-4e90-b44d-5bc6d4328880 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Request method failure captured: Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: POST /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570/os-volume_attachments HTTP/1.1 Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 74 Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFpofOqKz5CBf-8MdepxWHeAf9pqHZ8ygUVMa40UQbmj6S4Pciia3iBGqdVVK2sWWb-uohBfvQN9NFiLpHXqxqcuFtxzwWGZSpwMcdozNESD7s6BjUOpefCniYDb7sEM8Bcsphf4xva9kPBkQalQSLDW-EAJxbqQOqGbR6FCdDQnOg Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:47:22.471868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:47:22.473214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/40540f8322a54133bc32e1af000810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_40540f8322a54133bc32e1af000810ad", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:47:22.473214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:47:22.473214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:47:22.473214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:47:22.473214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:47:22.473214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:47:22.473214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:47:22.473214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 956aff831fa04d29ba5cffb88e73f4d2 Aug 03 10:47:22.473214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:47:22.473214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Aug 03 10:47:22.473214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {"volumeAttachment": {"volumeId": "739d4b15-2893-4360-9016-6c8263230878"}} Aug 03 10:47:22.473214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Invalid volume: volume 739d4b15-2893-4360-9016-6c8263230878 is already attached to instances: b6a399a7-91eb-41c8-b408-c5df154a36cc Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'server_id': 'd121b133-039a-4f9c-9caa-299cc961d570', 'body': {'volumeAttachment': {'volumeId': '739d4b15-2893-4360-9016-6c8263230878'}}} Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 739d4b15-2893-4360-9016-6c8263230878 is already attached to instances: b6a399a7-91eb-41c8-b408-c5df154a36cc Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:47:22.477943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 739d4b15-2893-4360-9016-6c8263230878 is already attached to instances: b6a399a7-91eb-41c8-b408-c5df154a36cc Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:47:22.479943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:47:22.481955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:47:22.481955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:47:22.481955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:47:22.481955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 739d4b15-2893-4360-9016-6c8263230878 is already attached to instances: b6a399a7-91eb-41c8-b408-c5df154a36cc Aug 03 10:47:22.481955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:47:22.481955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b60f5672-ba28-4e90-b44d-5bc6d4328880 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Returning 400 to user: Invalid volume: volume 739d4b15-2893-4360-9016-6c8263230878 is already attached to instances: b6a399a7-91eb-41c8-b408-c5df154a36cc {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:47:22.481955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b60f5672-ba28-4e90-b44d-5bc6d4328880 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "POST /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106358 Aug 03 10:47:22.481955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 228/444] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 3 10:47:22 2022] POST /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 10:47:22.482550 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-187a0e22-3e6a-4239-b71e-1e7a5c29b0cd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:22.482924 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-187a0e22-3e6a-4239-b71e-1e7a5c29b0cd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:22.490440 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-187a0e22-3e6a-4239-b71e-1e7a5c29b0cd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:22.490944 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-187a0e22-3e6a-4239-b71e-1e7a5c29b0cd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:22.492505 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-187a0e22-3e6a-4239-b71e-1e7a5c29b0cd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:22.492961 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-187a0e22-3e6a-4239-b71e-1e7a5c29b0cd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:22.496353 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:47:22.524724 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-187a0e22-3e6a-4239-b71e-1e7a5c29b0cd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Going to try to terminate instance {{(pid=124389) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:47:22.621527 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-187a0e22-3e6a-4239-b71e-1e7a5c29b0cd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 204 len: 0 microversion: 2.1 time: 0.142611 Aug 03 10:47:22.622121 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 217/445] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:47:22 2022] DELETE /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:47:22.631270 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0d7b3e88-d37b-45db-a25a-ad2330f8a56c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:22.631924 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0d7b3e88-d37b-45db-a25a-ad2330f8a56c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:22.639084 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d7b3e88-d37b-45db-a25a-ad2330f8a56c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:22.639519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d7b3e88-d37b-45db-a25a-ad2330f8a56c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:22.640291 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d7b3e88-d37b-45db-a25a-ad2330f8a56c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:22.640727 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d7b3e88-d37b-45db-a25a-ad2330f8a56c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:22.771935 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0d7b3e88-d37b-45db-a25a-ad2330f8a56c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:22.780632 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0d7b3e88-d37b-45db-a25a-ad2330f8a56c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1682 microversion: 2.1 time: 0.153944 Aug 03 10:47:22.781196 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 229/446] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:22 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:22.948959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-44d706e1-fc46-4b2b-832e-550d8f8afc3f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:22.949676 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-44d706e1-fc46-4b2b-832e-550d8f8afc3f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:22.956061 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-44d706e1-fc46-4b2b-832e-550d8f8afc3f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:22.956503 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-44d706e1-fc46-4b2b-832e-550d8f8afc3f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:22.958284 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-44d706e1-fc46-4b2b-832e-550d8f8afc3f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:22.959060 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-44d706e1-fc46-4b2b-832e-550d8f8afc3f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:23.106706 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-44d706e1-fc46-4b2b-832e-550d8f8afc3f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:23.116546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-44d706e1-fc46-4b2b-832e-550d8f8afc3f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:23.118107 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-44d706e1-fc46-4b2b-832e-550d8f8afc3f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:23.119387 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-44d706e1-fc46-4b2b-832e-550d8f8afc3f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.174692 Aug 03 10:47:23.125698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 218/447] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:22 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:23.248406 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e4db7dfc-8acc-48e2-95b7-eda43fc00a28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:23.249017 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e4db7dfc-8acc-48e2-95b7-eda43fc00a28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:23.255308 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e4db7dfc-8acc-48e2-95b7-eda43fc00a28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:23.255759 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e4db7dfc-8acc-48e2-95b7-eda43fc00a28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:23.256531 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e4db7dfc-8acc-48e2-95b7-eda43fc00a28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:23.256967 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e4db7dfc-8acc-48e2-95b7-eda43fc00a28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:23.415533 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e4db7dfc-8acc-48e2-95b7-eda43fc00a28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:23.423474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e4db7dfc-8acc-48e2-95b7-eda43fc00a28 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1678 microversion: 2.1 time: 0.178857 Aug 03 10:47:23.424066 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 230/448] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:23 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:23.801789 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-48ef092f-4226-4333-9ad3-0114aa7f3ee0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:23.802395 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-48ef092f-4226-4333-9ad3-0114aa7f3ee0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:23.808504 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-48ef092f-4226-4333-9ad3-0114aa7f3ee0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:23.808953 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-48ef092f-4226-4333-9ad3-0114aa7f3ee0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:23.809752 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-48ef092f-4226-4333-9ad3-0114aa7f3ee0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:23.810188 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-48ef092f-4226-4333-9ad3-0114aa7f3ee0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:23.957485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-48ef092f-4226-4333-9ad3-0114aa7f3ee0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:23.967287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-48ef092f-4226-4333-9ad3-0114aa7f3ee0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1682 microversion: 2.1 time: 0.169327 Aug 03 10:47:23.967851 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 219/449] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:23 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:24.143926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6f58a4e1-44ae-40a9-9133-ff6c95d0bd1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:24.144539 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6f58a4e1-44ae-40a9-9133-ff6c95d0bd1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:24.150554 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6f58a4e1-44ae-40a9-9133-ff6c95d0bd1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:24.150999 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6f58a4e1-44ae-40a9-9133-ff6c95d0bd1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:24.151770 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6f58a4e1-44ae-40a9-9133-ff6c95d0bd1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:24.152205 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6f58a4e1-44ae-40a9-9133-ff6c95d0bd1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:24.322264 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6f58a4e1-44ae-40a9-9133-ff6c95d0bd1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:24.333244 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6f58a4e1-44ae-40a9-9133-ff6c95d0bd1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:24.334824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6f58a4e1-44ae-40a9-9133-ff6c95d0bd1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:24.336540 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6f58a4e1-44ae-40a9-9133-ff6c95d0bd1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.195977 Aug 03 10:47:24.336734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 231/450] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:24 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:24.393646 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-b833dc5c-65b1-4fb0-9468-4d40716b4dc8 req-06cb1373-e6a6-4e45-bd8a-6910e0a74e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5895a291-434d-4b7c-85cd-0264cf37f5f3", "name": "network-vif-plugged", "status": "completed", "tag": "971e4968-4040-4784-a0ed-4c689d9711ff"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:47:24.409057 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-b833dc5c-65b1-4fb0-9468-4d40716b4dc8 req-06cb1373-e6a6-4e45-bd8a-6910e0a74e36 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:24.409741 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-b833dc5c-65b1-4fb0-9468-4d40716b4dc8 req-06cb1373-e6a6-4e45-bd8a-6910e0a74e36 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:24.425158 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-b833dc5c-65b1-4fb0-9468-4d40716b4dc8 req-06cb1373-e6a6-4e45-bd8a-6910e0a74e36 service nova] Creating event network-vif-plugged:971e4968-4040-4784-a0ed-4c689d9711ff for instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 on hv-cinder-85083 Aug 03 10:47:24.435636 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-b833dc5c-65b1-4fb0-9468-4d40716b4dc8 req-06cb1373-e6a6-4e45-bd8a-6910e0a74e36 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049127 Aug 03 10:47:24.436663 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 220/451] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:47:24.447228 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6d0f12fe-6f0a-4c98-b4ac-bccb361c7172 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:24.447868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6d0f12fe-6f0a-4c98-b4ac-bccb361c7172 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:24.454299 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d0f12fe-6f0a-4c98-b4ac-bccb361c7172 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:24.455337 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d0f12fe-6f0a-4c98-b4ac-bccb361c7172 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:24.456141 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d0f12fe-6f0a-4c98-b4ac-bccb361c7172 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:24.457193 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d0f12fe-6f0a-4c98-b4ac-bccb361c7172 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:24.618213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6d0f12fe-6f0a-4c98-b4ac-bccb361c7172 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:24.626165 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6d0f12fe-6f0a-4c98-b4ac-bccb361c7172 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1678 microversion: 2.1 time: 0.183827 Aug 03 10:47:24.627036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 232/452] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:24 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:24.990344 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-fbbdaa74-8376-46a9-b8ac-4f0cb5545ddb tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:24.992432 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-fbbdaa74-8376-46a9-b8ac-4f0cb5545ddb tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:25.001603 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fbbdaa74-8376-46a9-b8ac-4f0cb5545ddb tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:25.002548 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fbbdaa74-8376-46a9-b8ac-4f0cb5545ddb tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:25.003609 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fbbdaa74-8376-46a9-b8ac-4f0cb5545ddb tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:25.004443 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fbbdaa74-8376-46a9-b8ac-4f0cb5545ddb tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:25.164687 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fbbdaa74-8376-46a9-b8ac-4f0cb5545ddb tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:25.175203 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-fbbdaa74-8376-46a9-b8ac-4f0cb5545ddb tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1682 microversion: 2.1 time: 0.190464 Aug 03 10:47:25.176027 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 221/453] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:24 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1682 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:47:25.365008 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e6c84f37-008e-404c-9a21-84171af73dd7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:25.365749 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e6c84f37-008e-404c-9a21-84171af73dd7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:25.372682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e6c84f37-008e-404c-9a21-84171af73dd7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:25.373257 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e6c84f37-008e-404c-9a21-84171af73dd7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:25.374252 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e6c84f37-008e-404c-9a21-84171af73dd7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:25.374708 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e6c84f37-008e-404c-9a21-84171af73dd7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:25.521417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e6c84f37-008e-404c-9a21-84171af73dd7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:25.530566 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e6c84f37-008e-404c-9a21-84171af73dd7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:25.532224 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e6c84f37-008e-404c-9a21-84171af73dd7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:25.533395 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e6c84f37-008e-404c-9a21-84171af73dd7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.173030 Aug 03 10:47:25.533988 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 233/454] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:25 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:25.657034 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ea3e231d-23f8-4c5f-92bb-a9bfa03d8356 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:25.658288 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-ea3e231d-23f8-4c5f-92bb-a9bfa03d8356 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:25.668159 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ea3e231d-23f8-4c5f-92bb-a9bfa03d8356 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:25.669056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ea3e231d-23f8-4c5f-92bb-a9bfa03d8356 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:25.670107 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ea3e231d-23f8-4c5f-92bb-a9bfa03d8356 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:25.670890 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ea3e231d-23f8-4c5f-92bb-a9bfa03d8356 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:25.857190 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-ea3e231d-23f8-4c5f-92bb-a9bfa03d8356 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:25.866762 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ea3e231d-23f8-4c5f-92bb-a9bfa03d8356 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1678 microversion: 2.1 time: 0.222780 Aug 03 10:47:25.867816 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 222/455] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:25 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:25.948419 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-3d72144c-91ee-4799-a708-ef61b1a7461e req-4cc6186b-a798-4e75-a307-dad3b0779119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d121b133-039a-4f9c-9caa-299cc961d570", "name": "network-vif-deleted", "tag": "107092f8-4e20-4d57-9423-1448baab2b16"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:47:25.958732 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-3d72144c-91ee-4799-a708-ef61b1a7461e req-4cc6186b-a798-4e75-a307-dad3b0779119 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:25.959177 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-3d72144c-91ee-4799-a708-ef61b1a7461e req-4cc6186b-a798-4e75-a307-dad3b0779119 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:25.973152 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-3d72144c-91ee-4799-a708-ef61b1a7461e req-4cc6186b-a798-4e75-a307-dad3b0779119 service nova] Creating event network-vif-deleted:107092f8-4e20-4d57-9423-1448baab2b16 for instance d121b133-039a-4f9c-9caa-299cc961d570 on hv-cinder-85083 Aug 03 10:47:25.978212 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-3d72144c-91ee-4799-a708-ef61b1a7461e req-4cc6186b-a798-4e75-a307-dad3b0779119 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033886 Aug 03 10:47:25.978808 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 234/456] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:47:26.220035 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b13b6fee-2ddd-46b7-9ddf-fc97afb4e933 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:26.220634 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b13b6fee-2ddd-46b7-9ddf-fc97afb4e933 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:26.228111 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b13b6fee-2ddd-46b7-9ddf-fc97afb4e933 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:26.229070 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b13b6fee-2ddd-46b7-9ddf-fc97afb4e933 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:26.230547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b13b6fee-2ddd-46b7-9ddf-fc97afb4e933 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:26.230988 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b13b6fee-2ddd-46b7-9ddf-fc97afb4e933 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:26.308735 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b13b6fee-2ddd-46b7-9ddf-fc97afb4e933 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:26.317542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b13b6fee-2ddd-46b7-9ddf-fc97afb4e933 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1614 microversion: 2.1 time: 0.101337 Aug 03 10:47:26.318309 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 223/457] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:26 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1614 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:47:26.559560 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4974a111-179a-482c-9dcc-52e708ea4255 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:26.561275 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4974a111-179a-482c-9dcc-52e708ea4255 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:26.568683 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4974a111-179a-482c-9dcc-52e708ea4255 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:26.569122 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4974a111-179a-482c-9dcc-52e708ea4255 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:26.570122 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4974a111-179a-482c-9dcc-52e708ea4255 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:26.570579 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4974a111-179a-482c-9dcc-52e708ea4255 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:26.759958 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4974a111-179a-482c-9dcc-52e708ea4255 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:26.777424 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4974a111-179a-482c-9dcc-52e708ea4255 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:26.779064 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4974a111-179a-482c-9dcc-52e708ea4255 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:26.780299 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4974a111-179a-482c-9dcc-52e708ea4255 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.225369 Aug 03 10:47:26.780862 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 235/458] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:26 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:26.888184 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d1871707-f495-4629-8529-94550d2dcecb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:26.888979 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d1871707-f495-4629-8529-94550d2dcecb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:26.895981 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d1871707-f495-4629-8529-94550d2dcecb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:26.896540 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d1871707-f495-4629-8529-94550d2dcecb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:26.897613 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d1871707-f495-4629-8529-94550d2dcecb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:26.898139 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d1871707-f495-4629-8529-94550d2dcecb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:27.093933 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d1871707-f495-4629-8529-94550d2dcecb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:27.103176 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d1871707-f495-4629-8529-94550d2dcecb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1678 microversion: 2.1 time: 0.218822 Aug 03 10:47:27.104098 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 224/459] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:26 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:47:27.339487 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-434f8cc6-da94-44d8-81f9-d78a4f3c9a66 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:27.340102 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-434f8cc6-da94-44d8-81f9-d78a4f3c9a66 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:27.349086 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-434f8cc6-da94-44d8-81f9-d78a4f3c9a66 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:27.349574 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-434f8cc6-da94-44d8-81f9-d78a4f3c9a66 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:27.350498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-434f8cc6-da94-44d8-81f9-d78a4f3c9a66 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:27.351586 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-434f8cc6-da94-44d8-81f9-d78a4f3c9a66 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:27.431634 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-434f8cc6-da94-44d8-81f9-d78a4f3c9a66 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:27.435229 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-434f8cc6-da94-44d8-81f9-d78a4f3c9a66 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:27.435229 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-434f8cc6-da94-44d8-81f9-d78a4f3c9a66 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lazy-loading 'fault' on Instance uuid d121b133-039a-4f9c-9caa-299cc961d570 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:47:27.531303 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-434f8cc6-da94-44d8-81f9-d78a4f3c9a66 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:27.549928 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-434f8cc6-da94-44d8-81f9-d78a4f3c9a66 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 200 len: 1331 microversion: 2.1 time: 0.214591 Aug 03 10:47:27.561514 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 236/460] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:27 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 1331 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:27.804021 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-40468212-3d74-46ff-a076-b8d1193f918f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:27.804788 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-40468212-3d74-46ff-a076-b8d1193f918f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:27.811842 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-40468212-3d74-46ff-a076-b8d1193f918f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:27.812279 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-40468212-3d74-46ff-a076-b8d1193f918f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:27.813050 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-40468212-3d74-46ff-a076-b8d1193f918f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:27.813526 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-40468212-3d74-46ff-a076-b8d1193f918f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:27.945961 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-40468212-3d74-46ff-a076-b8d1193f918f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:27.955178 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-40468212-3d74-46ff-a076-b8d1193f918f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:27.957200 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-40468212-3d74-46ff-a076-b8d1193f918f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:27.958403 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-40468212-3d74-46ff-a076-b8d1193f918f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1808 microversion: 2.20 time: 0.158429 Aug 03 10:47:27.958962 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 225/461] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:27 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:28.127076 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cc57489d-8ba1-4ee6-b83f-08d259fa53ab tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:28.127602 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-cc57489d-8ba1-4ee6-b83f-08d259fa53ab tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:28.134907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc57489d-8ba1-4ee6-b83f-08d259fa53ab tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:28.135724 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc57489d-8ba1-4ee6-b83f-08d259fa53ab tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:28.136539 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc57489d-8ba1-4ee6-b83f-08d259fa53ab tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:28.136984 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc57489d-8ba1-4ee6-b83f-08d259fa53ab tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:28.343906 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-cc57489d-8ba1-4ee6-b83f-08d259fa53ab tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:28.357428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-cc57489d-8ba1-4ee6-b83f-08d259fa53ab tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1678 microversion: 2.1 time: 0.233943 Aug 03 10:47:28.358515 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 237/462] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:28 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:28.575724 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a0ae1ab3-2fb0-4c3e-94a4-3a6ed733de14 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:28.576519 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-a0ae1ab3-2fb0-4c3e-94a4-3a6ed733de14 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:28.584592 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a0ae1ab3-2fb0-4c3e-94a4-3a6ed733de14 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:28.585197 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a0ae1ab3-2fb0-4c3e-94a4-3a6ed733de14 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:28.586144 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a0ae1ab3-2fb0-4c3e-94a4-3a6ed733de14 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:28.586738 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a0ae1ab3-2fb0-4c3e-94a4-3a6ed733de14 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:28.604277 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-a0ae1ab3-2fb0-4c3e-94a4-3a6ed733de14 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] HTTP exception thrown: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a0ae1ab3-2fb0-4c3e-94a4-3a6ed733de14 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Request method failure captured: Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 HTTP/1.1 Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lFpofOqKz5CBf-8MdepxWHeAf9pqHZ8ygUVMa40UQbmj6S4Pciia3iBGqdVVK2sWWb-uohBfvQN9NFiLpHXqxqcuFtxzwWGZSpwMcdozNESD7s6BjUOpefCniYDb7sEM8Bcsphf4xva9kPBkQalQSLDW-EAJxbqQOqGbR6FCdDQnOg Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:47:28.606273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:47:28.607669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/40540f8322a54133bc32e1af000810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_40540f8322a54133bc32e1af000810ad", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:47:28.607669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:47:28.607669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:47:28.607669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:47:28.607669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:47:28.607669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:47:28.607669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:47:28.607669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 956aff831fa04d29ba5cffb88e73f4d2 Aug 03 10:47:28.607669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:47:28.607669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:47:28.607669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. Aug 03 10:47:28.607669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': 'd121b133-039a-4f9c-9caa-299cc961d570'} Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:47:28.608416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. Aug 03 10:47:28.609645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:47:28.611885 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a0ae1ab3-2fb0-4c3e-94a4-3a6ed733de14 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Returning 404 to user: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:47:28.611885 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-a0ae1ab3-2fb0-4c3e-94a4-3a6ed733de14 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 404 len: 111 microversion: 2.1 time: 0.036829 Aug 03 10:47:28.611885 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 226/463] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:28 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:47:28.619199 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-335f2271-cb23-4ffa-999d-3dee7a090d9c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '.version_select at 0x7fbd107f9280>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:28.646326 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-335f2271-cb23-4ffa-999d-3dee7a090d9c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-432022352" status: 202 len: 0 microversion: 2.1 time: 0.030863 Aug 03 10:47:28.652117 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 238/464] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Aug 3 10:47:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-432022352 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:47:28.981864 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e26daf65-463c-433f-9c0d-0e50e4a45ba2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:28.983058 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e26daf65-463c-433f-9c0d-0e50e4a45ba2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:28.990952 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e26daf65-463c-433f-9c0d-0e50e4a45ba2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:28.991530 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e26daf65-463c-433f-9c0d-0e50e4a45ba2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:28.992291 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e26daf65-463c-433f-9c0d-0e50e4a45ba2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:28.992744 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e26daf65-463c-433f-9c0d-0e50e4a45ba2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:29.140713 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e26daf65-463c-433f-9c0d-0e50e4a45ba2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:29.150480 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e26daf65-463c-433f-9c0d-0e50e4a45ba2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:29.151907 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e26daf65-463c-433f-9c0d-0e50e4a45ba2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:29.153100 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e26daf65-463c-433f-9c0d-0e50e4a45ba2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1795 microversion: 2.20 time: 0.175177 Aug 03 10:47:29.153686 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 227/465] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:47:28 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1795 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:47:29.393778 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b6243b43-b4d7-4841-b677-59cf90e129c3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:29.393778 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b6243b43-b4d7-4841-b677-59cf90e129c3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:29.394029 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-0ebd001e-7f3c-4986-a513-d4a8e7b0bd27 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:29.394029 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-0ebd001e-7f3c-4986-a513-d4a8e7b0bd27 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:29.399623 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0ebd001e-7f3c-4986-a513-d4a8e7b0bd27 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:29.400078 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0ebd001e-7f3c-4986-a513-d4a8e7b0bd27 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:29.400936 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0ebd001e-7f3c-4986-a513-d4a8e7b0bd27 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:29.401314 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0ebd001e-7f3c-4986-a513-d4a8e7b0bd27 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:29.405063 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b6243b43-b4d7-4841-b677-59cf90e129c3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:29.405891 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b6243b43-b4d7-4841-b677-59cf90e129c3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:29.407214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b6243b43-b4d7-4841-b677-59cf90e129c3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:29.407955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b6243b43-b4d7-4841-b677-59cf90e129c3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:29.553365 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-0ebd001e-7f3c-4986-a513-d4a8e7b0bd27 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lazy-loading 'services' on Instance uuid b6a399a7-91eb-41c8-b408-c5df154a36cc {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:47:29.592948 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b6243b43-b4d7-4841-b677-59cf90e129c3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:29.601121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b6243b43-b4d7-4841-b677-59cf90e129c3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1678 microversion: 2.1 time: 0.223114 Aug 03 10:47:29.602054 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 239/466] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:29 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:47:29.702667 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-0ebd001e-7f3c-4986-a513-d4a8e7b0bd27 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-volume_attachments/739d4b15-2893-4360-9016-6c8263230878" status: 202 len: 0 microversion: 2.1 time: 0.314184 Aug 03 10:47:29.703523 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 228/467] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 3 10:47:29 2022] DELETE /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-volume_attachments/739d4b15-2893-4360-9016-6c8263230878 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 10:47:29.713653 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f4dd7cde-f449-412c-af34-1c582489110c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:29.716591 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f4dd7cde-f449-412c-af34-1c582489110c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:29.723808 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f4dd7cde-f449-412c-af34-1c582489110c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:29.724669 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f4dd7cde-f449-412c-af34-1c582489110c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:29.725771 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f4dd7cde-f449-412c-af34-1c582489110c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:29.726208 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f4dd7cde-f449-412c-af34-1c582489110c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:29.760463 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f4dd7cde-f449-412c-af34-1c582489110c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051086 Aug 03 10:47:29.761025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 240/468] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:47:29 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:47:30.637240 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d5c6f0f0-629f-45e7-b2db-64fa1a564057 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:30.637891 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d5c6f0f0-629f-45e7-b2db-64fa1a564057 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:30.644419 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d5c6f0f0-629f-45e7-b2db-64fa1a564057 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:30.645360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d5c6f0f0-629f-45e7-b2db-64fa1a564057 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:30.646162 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d5c6f0f0-629f-45e7-b2db-64fa1a564057 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:30.646594 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d5c6f0f0-629f-45e7-b2db-64fa1a564057 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:30.774158 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-92cbe5b2-75ca-4e3d-be3c-7f27ceba1f84 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:30.776353 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-92cbe5b2-75ca-4e3d-be3c-7f27ceba1f84 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:30.783232 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-92cbe5b2-75ca-4e3d-be3c-7f27ceba1f84 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:30.783790 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-92cbe5b2-75ca-4e3d-be3c-7f27ceba1f84 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:30.784655 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-92cbe5b2-75ca-4e3d-be3c-7f27ceba1f84 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:30.785135 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-92cbe5b2-75ca-4e3d-be3c-7f27ceba1f84 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:30.786650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d5c6f0f0-629f-45e7-b2db-64fa1a564057 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:30.794465 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d5c6f0f0-629f-45e7-b2db-64fa1a564057 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1678 microversion: 2.1 time: 0.162158 Aug 03 10:47:30.795047 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 229/469] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:30 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:30.817263 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:47:30.822474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-92cbe5b2-75ca-4e3d-be3c-7f27ceba1f84 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052331 Aug 03 10:47:30.823042 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 241/470] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:47:30 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:47:31.816314 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e4ccab89-2511-4510-803a-fa2dc941cc73 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:31.816920 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e4ccab89-2511-4510-803a-fa2dc941cc73 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:31.823581 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e4ccab89-2511-4510-803a-fa2dc941cc73 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:31.824028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e4ccab89-2511-4510-803a-fa2dc941cc73 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:31.824803 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e4ccab89-2511-4510-803a-fa2dc941cc73 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:31.825232 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e4ccab89-2511-4510-803a-fa2dc941cc73 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:31.836286 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a0d31c6b-aab3-4e92-9678-fc3813c6944f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:31.838528 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a0d31c6b-aab3-4e92-9678-fc3813c6944f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:31.845488 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a0d31c6b-aab3-4e92-9678-fc3813c6944f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:31.846047 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a0d31c6b-aab3-4e92-9678-fc3813c6944f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:31.846654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a0d31c6b-aab3-4e92-9678-fc3813c6944f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:31.847081 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a0d31c6b-aab3-4e92-9678-fc3813c6944f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:31.883009 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a0d31c6b-aab3-4e92-9678-fc3813c6944f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051775 Aug 03 10:47:31.883596 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 242/471] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:47:31 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:47:31.983036 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e4ccab89-2511-4510-803a-fa2dc941cc73 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:31.991106 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e4ccab89-2511-4510-803a-fa2dc941cc73 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1678 microversion: 2.1 time: 0.178579 Aug 03 10:47:31.991682 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 230/472] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:31 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:32.897228 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7aa71c1c-cc96-4819-9103-a3b3e3e91c04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:32.899418 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7aa71c1c-cc96-4819-9103-a3b3e3e91c04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:32.906008 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7aa71c1c-cc96-4819-9103-a3b3e3e91c04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:32.906462 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7aa71c1c-cc96-4819-9103-a3b3e3e91c04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:32.907239 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7aa71c1c-cc96-4819-9103-a3b3e3e91c04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:32.907674 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7aa71c1c-cc96-4819-9103-a3b3e3e91c04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:32.940913 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7aa71c1c-cc96-4819-9103-a3b3e3e91c04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047591 Aug 03 10:47:32.941411 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 243/473] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:47:32 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:47:33.013810 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2baff6f1-0c8d-4549-9b2a-c76a64297f12 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:33.014472 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2baff6f1-0c8d-4549-9b2a-c76a64297f12 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:33.021492 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2baff6f1-0c8d-4549-9b2a-c76a64297f12 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:33.022042 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2baff6f1-0c8d-4549-9b2a-c76a64297f12 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:33.022828 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2baff6f1-0c8d-4549-9b2a-c76a64297f12 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:33.023268 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2baff6f1-0c8d-4549-9b2a-c76a64297f12 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:33.161382 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2baff6f1-0c8d-4549-9b2a-c76a64297f12 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:33.169426 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2baff6f1-0c8d-4549-9b2a-c76a64297f12 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1678 microversion: 2.1 time: 0.159817 Aug 03 10:47:33.170047 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 231/474] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:33 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:33.954823 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6170b73d-cab4-4507-81a4-424ae82c5d46 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:33.957006 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6170b73d-cab4-4507-81a4-424ae82c5d46 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:33.970541 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6170b73d-cab4-4507-81a4-424ae82c5d46 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:33.971274 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6170b73d-cab4-4507-81a4-424ae82c5d46 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:33.973513 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6170b73d-cab4-4507-81a4-424ae82c5d46 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:33.974254 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6170b73d-cab4-4507-81a4-424ae82c5d46 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:34.011385 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6170b73d-cab4-4507-81a4-424ae82c5d46 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060539 Aug 03 10:47:34.012430 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 244/475] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:47:33 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 10:47:34.077278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c30e3775-5a56-431d-9893-98c204bc6b64 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:34.077923 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-c30e3775-5a56-431d-9893-98c204bc6b64 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:34.085277 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c30e3775-5a56-431d-9893-98c204bc6b64 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:34.085856 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c30e3775-5a56-431d-9893-98c204bc6b64 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:34.086752 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c30e3775-5a56-431d-9893-98c204bc6b64 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:34.087261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c30e3775-5a56-431d-9893-98c204bc6b64 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:34.114917 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-c30e3775-5a56-431d-9893-98c204bc6b64 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Going to try to terminate instance {{(pid=124389) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:47:34.117795 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:47:34.192981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-728697af-cb16-45d1-9ea6-41a114ccf339 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:34.193436 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c30e3775-5a56-431d-9893-98c204bc6b64 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 204 len: 0 microversion: 2.1 time: 0.119633 Aug 03 10:47:34.194129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-728697af-cb16-45d1-9ea6-41a114ccf339 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:34.198060 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 232/476] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:47:34 2022] DELETE /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:47:34.205581 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-728697af-cb16-45d1-9ea6-41a114ccf339 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:34.206364 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-728697af-cb16-45d1-9ea6-41a114ccf339 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:34.207894 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-728697af-cb16-45d1-9ea6-41a114ccf339 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:34.208485 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-728697af-cb16-45d1-9ea6-41a114ccf339 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:34.211495 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-0bf93225-a43c-4f72-97ef-59889cc65c4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:34.212208 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-0bf93225-a43c-4f72-97ef-59889cc65c4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:34.233044 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0bf93225-a43c-4f72-97ef-59889cc65c4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:34.233856 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0bf93225-a43c-4f72-97ef-59889cc65c4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:34.236401 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0bf93225-a43c-4f72-97ef-59889cc65c4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:34.237053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0bf93225-a43c-4f72-97ef-59889cc65c4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:34.461497 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-728697af-cb16-45d1-9ea6-41a114ccf339 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:34.469496 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-728697af-cb16-45d1-9ea6-41a114ccf339 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1678 microversion: 2.1 time: 0.282166 Aug 03 10:47:34.470185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 245/477] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:34 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1678 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:34.477503 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-0bf93225-a43c-4f72-97ef-59889cc65c4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:34.490947 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-0bf93225-a43c-4f72-97ef-59889cc65c4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1681 microversion: 2.1 time: 0.285865 Aug 03 10:47:34.491534 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 233/478] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:34 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1681 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:35.491878 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c58ff76c-e453-4dd4-8ce2-dd1089e20a8f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:35.492475 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c58ff76c-e453-4dd4-8ce2-dd1089e20a8f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:35.498666 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c58ff76c-e453-4dd4-8ce2-dd1089e20a8f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:35.499115 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c58ff76c-e453-4dd4-8ce2-dd1089e20a8f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:35.499881 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c58ff76c-e453-4dd4-8ce2-dd1089e20a8f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:35.500315 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c58ff76c-e453-4dd4-8ce2-dd1089e20a8f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:35.512487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-aca03495-f883-4996-ac98-6946da7f7063 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:35.513091 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-aca03495-f883-4996-ac98-6946da7f7063 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:35.521026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aca03495-f883-4996-ac98-6946da7f7063 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:35.521491 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aca03495-f883-4996-ac98-6946da7f7063 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:35.522258 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aca03495-f883-4996-ac98-6946da7f7063 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:35.522684 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aca03495-f883-4996-ac98-6946da7f7063 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:35.688174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c58ff76c-e453-4dd4-8ce2-dd1089e20a8f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:35.696674 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c58ff76c-e453-4dd4-8ce2-dd1089e20a8f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1678 microversion: 2.1 time: 0.208975 Aug 03 10:47:35.697265 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 246/479] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:35 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:35.712568 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-aca03495-f883-4996-ac98-6946da7f7063 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:35.720167 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-aca03495-f883-4996-ac98-6946da7f7063 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1681 microversion: 2.1 time: 0.211416 Aug 03 10:47:35.720747 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 234/480] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:35 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:47:36.718319 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-61b26ef5-0c85-4c71-b406-2dcb626ea834 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:36.718924 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-61b26ef5-0c85-4c71-b406-2dcb626ea834 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:36.725501 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-61b26ef5-0c85-4c71-b406-2dcb626ea834 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:36.725953 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-61b26ef5-0c85-4c71-b406-2dcb626ea834 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:36.726707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-61b26ef5-0c85-4c71-b406-2dcb626ea834 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:36.727135 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-61b26ef5-0c85-4c71-b406-2dcb626ea834 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:36.742213 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-adc67c72-9a6e-4c7b-b825-1452c17d89e5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:36.742857 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-adc67c72-9a6e-4c7b-b825-1452c17d89e5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:36.745244 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:47:36.750613 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-adc67c72-9a6e-4c7b-b825-1452c17d89e5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:36.751053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-adc67c72-9a6e-4c7b-b825-1452c17d89e5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:36.751817 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-adc67c72-9a6e-4c7b-b825-1452c17d89e5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:36.752233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-adc67c72-9a6e-4c7b-b825-1452c17d89e5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:36.925135 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-61b26ef5-0c85-4c71-b406-2dcb626ea834 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:36.932737 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-61b26ef5-0c85-4c71-b406-2dcb626ea834 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1678 microversion: 2.1 time: 0.218257 Aug 03 10:47:36.934025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 247/481] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:36 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:36.936316 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-adc67c72-9a6e-4c7b-b825-1452c17d89e5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:36.944663 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-adc67c72-9a6e-4c7b-b825-1452c17d89e5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1681 microversion: 2.1 time: 0.206881 Aug 03 10:47:36.945214 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 235/482] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:36 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1681 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:47:37.954434 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2a940b79-d073-49f9-9df6-d7204cf6510c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:37.955045 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2a940b79-d073-49f9-9df6-d7204cf6510c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:37.962140 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a940b79-d073-49f9-9df6-d7204cf6510c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:37.962593 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a940b79-d073-49f9-9df6-d7204cf6510c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:37.963363 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a940b79-d073-49f9-9df6-d7204cf6510c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:37.963794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a940b79-d073-49f9-9df6-d7204cf6510c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:37.967264 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2a8e055e-b870-4720-9e29-0a86063d41d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:37.968011 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2a8e055e-b870-4720-9e29-0a86063d41d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:37.975264 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2a8e055e-b870-4720-9e29-0a86063d41d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:37.975702 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2a8e055e-b870-4720-9e29-0a86063d41d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:37.976783 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2a8e055e-b870-4720-9e29-0a86063d41d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:37.977282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2a8e055e-b870-4720-9e29-0a86063d41d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:38.190694 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2a940b79-d073-49f9-9df6-d7204cf6510c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:38.192712 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2a8e055e-b870-4720-9e29-0a86063d41d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:38.208080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2a8e055e-b870-4720-9e29-0a86063d41d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1681 microversion: 2.1 time: 0.245030 Aug 03 10:47:38.208670 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 236/483] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:37 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1681 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:47:38.220392 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2a940b79-d073-49f9-9df6-d7204cf6510c tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1678 microversion: 2.1 time: 0.269542 Aug 03 10:47:38.234384 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 248/484] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:37 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1678 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:39.086224 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-8dc43a17-c30c-4d34-b625-4a9081a6fc55 req-ba9ebba3-ae32-493b-a4af-e3dce477c7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a399a7-91eb-41c8-b408-c5df154a36cc", "name": "network-vif-deleted", "tag": "50f0f005-5fa8-46f1-aa89-9825cf666e40"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:47:39.098310 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-8dc43a17-c30c-4d34-b625-4a9081a6fc55 req-ba9ebba3-ae32-493b-a4af-e3dce477c7ae service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:39.098873 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-8dc43a17-c30c-4d34-b625-4a9081a6fc55 req-ba9ebba3-ae32-493b-a4af-e3dce477c7ae service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:39.110381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-8dc43a17-c30c-4d34-b625-4a9081a6fc55 req-ba9ebba3-ae32-493b-a4af-e3dce477c7ae service nova] Creating event network-vif-deleted:50f0f005-5fa8-46f1-aa89-9825cf666e40 for instance b6a399a7-91eb-41c8-b408-c5df154a36cc on hv-cinder-85083 Aug 03 10:47:39.116259 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-8dc43a17-c30c-4d34-b625-4a9081a6fc55 req-ba9ebba3-ae32-493b-a4af-e3dce477c7ae service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034561 Aug 03 10:47:39.116934 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 237/485] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:47:39.233512 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-38ed0d1f-86cf-458d-ae61-f63ef8880ba5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:39.234246 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-38ed0d1f-86cf-458d-ae61-f63ef8880ba5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:39.241392 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-38ed0d1f-86cf-458d-ae61-f63ef8880ba5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:39.241956 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-38ed0d1f-86cf-458d-ae61-f63ef8880ba5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:39.242895 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-38ed0d1f-86cf-458d-ae61-f63ef8880ba5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:39.243508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-38ed0d1f-86cf-458d-ae61-f63ef8880ba5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:39.250280 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3034edec-0517-430e-bad1-a2e6870dcaa7 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:39.250985 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3034edec-0517-430e-bad1-a2e6870dcaa7 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:39.258249 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3034edec-0517-430e-bad1-a2e6870dcaa7 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:39.258695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3034edec-0517-430e-bad1-a2e6870dcaa7 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:39.259477 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3034edec-0517-430e-bad1-a2e6870dcaa7 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:39.259903 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3034edec-0517-430e-bad1-a2e6870dcaa7 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:39.310307 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-38ed0d1f-86cf-458d-ae61-f63ef8880ba5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:39.318721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-38ed0d1f-86cf-458d-ae61-f63ef8880ba5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1613 microversion: 2.1 time: 0.089099 Aug 03 10:47:39.319613 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 249/486] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:39 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:39.412948 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3034edec-0517-430e-bad1-a2e6870dcaa7 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:39.420735 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3034edec-0517-430e-bad1-a2e6870dcaa7 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1655 microversion: 2.1 time: 0.176702 Aug 03 10:47:39.421306 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 238/487] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:39 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1655 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:47:39.441843 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-306aac4f-0ee6-424b-a352-e54bbd473a7f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:47:39.448343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-306aac4f-0ee6-424b-a352-e54bbd473a7f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:39.448793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-306aac4f-0ee6-424b-a352-e54bbd473a7f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:39.470790 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-306aac4f-0ee6-424b-a352-e54bbd473a7f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Going to try to start instance {{(pid=124388) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 10:47:39.514225 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-306aac4f-0ee6-424b-a352-e54bbd473a7f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "POST /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/action" status: 202 len: 0 microversion: 2.1 time: 0.076373 Aug 03 10:47:39.514820 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 250/488] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 3 10:47:39 2022] POST /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 10:47:39.522879 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-831ede1b-9fe2-49e1-9154-946f4284a70f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:39.523570 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-831ede1b-9fe2-49e1-9154-946f4284a70f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:39.529633 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-831ede1b-9fe2-49e1-9154-946f4284a70f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:39.530155 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-831ede1b-9fe2-49e1-9154-946f4284a70f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:39.530983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-831ede1b-9fe2-49e1-9154-946f4284a70f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:39.531415 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-831ede1b-9fe2-49e1-9154-946f4284a70f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:39.668126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-831ede1b-9fe2-49e1-9154-946f4284a70f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:39.676437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-831ede1b-9fe2-49e1-9154-946f4284a70f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1664 microversion: 2.1 time: 0.156785 Aug 03 10:47:39.677001 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 239/489] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:39 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:40.344270 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b661015d-f447-4ad7-8465-ece73ed3d614 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:40.344966 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b661015d-f447-4ad7-8465-ece73ed3d614 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:40.361574 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b661015d-f447-4ad7-8465-ece73ed3d614 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:40.362752 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b661015d-f447-4ad7-8465-ece73ed3d614 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:40.362876 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b661015d-f447-4ad7-8465-ece73ed3d614 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:40.363884 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b661015d-f447-4ad7-8465-ece73ed3d614 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:40.429657 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b661015d-f447-4ad7-8465-ece73ed3d614 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:40.437383 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b661015d-f447-4ad7-8465-ece73ed3d614 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1326 microversion: 2.1 time: 0.097279 Aug 03 10:47:40.437998 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 251/490] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:40 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:40.698833 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-234de4b6-6838-4ff2-bf58-f7d21fffccb1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:40.699473 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-234de4b6-6838-4ff2-bf58-f7d21fffccb1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:40.707788 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-234de4b6-6838-4ff2-bf58-f7d21fffccb1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:40.708234 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-234de4b6-6838-4ff2-bf58-f7d21fffccb1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:40.708997 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-234de4b6-6838-4ff2-bf58-f7d21fffccb1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:40.710277 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-234de4b6-6838-4ff2-bf58-f7d21fffccb1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:40.839118 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-234de4b6-6838-4ff2-bf58-f7d21fffccb1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:40.846559 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-234de4b6-6838-4ff2-bf58-f7d21fffccb1 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1664 microversion: 2.1 time: 0.151790 Aug 03 10:47:40.847116 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 240/491] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:40 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:41.458241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3aeba4c9-9c16-416e-bf07-7b87ceda69d5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:41.458854 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3aeba4c9-9c16-416e-bf07-7b87ceda69d5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:41.465144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3aeba4c9-9c16-416e-bf07-7b87ceda69d5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:41.465640 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3aeba4c9-9c16-416e-bf07-7b87ceda69d5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:41.466481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3aeba4c9-9c16-416e-bf07-7b87ceda69d5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:41.466928 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3aeba4c9-9c16-416e-bf07-7b87ceda69d5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:41.499778 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3aeba4c9-9c16-416e-bf07-7b87ceda69d5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:41.500231 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3aeba4c9-9c16-416e-bf07-7b87ceda69d5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:41.500688 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-3aeba4c9-9c16-416e-bf07-7b87ceda69d5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lazy-loading 'fault' on Instance uuid b6a399a7-91eb-41c8-b408-c5df154a36cc {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:47:41.540959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3aeba4c9-9c16-416e-bf07-7b87ceda69d5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:41.549205 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3aeba4c9-9c16-416e-bf07-7b87ceda69d5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 200 len: 1331 microversion: 2.1 time: 0.094483 Aug 03 10:47:41.549436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 252/492] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:41 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:41.868834 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-fc820578-a388-4757-92c1-2cf189c1438f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:41.869443 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-fc820578-a388-4757-92c1-2cf189c1438f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:41.876069 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fc820578-a388-4757-92c1-2cf189c1438f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:41.876541 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fc820578-a388-4757-92c1-2cf189c1438f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:41.877295 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fc820578-a388-4757-92c1-2cf189c1438f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:41.877756 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fc820578-a388-4757-92c1-2cf189c1438f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:42.012082 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fc820578-a388-4757-92c1-2cf189c1438f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:42.020589 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-fc820578-a388-4757-92c1-2cf189c1438f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1664 microversion: 2.1 time: 0.155086 Aug 03 10:47:42.021166 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 241/493] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:41 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:42.572336 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f24bfa18-570e-46ba-9d95-8fb4d65b4662 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:42.573095 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f24bfa18-570e-46ba-9d95-8fb4d65b4662 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:42.579272 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f24bfa18-570e-46ba-9d95-8fb4d65b4662 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:42.579720 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f24bfa18-570e-46ba-9d95-8fb4d65b4662 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:42.580488 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f24bfa18-570e-46ba-9d95-8fb4d65b4662 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:42.581097 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f24bfa18-570e-46ba-9d95-8fb4d65b4662 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:42.600006 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-f24bfa18-570e-46ba-9d95-8fb4d65b4662 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] HTTP exception thrown: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f24bfa18-570e-46ba-9d95-8fb4d65b4662 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Request method failure captured: Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc HTTP/1.1 Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFpofOqKz5CBf-8MdepxWHeAf9pqHZ8ygUVMa40UQbmj6S4Pciia3iBGqdVVK2sWWb-uohBfvQN9NFiLpHXqxqcuFtxzwWGZSpwMcdozNESD7s6BjUOpefCniYDb7sEM8Bcsphf4xva9kPBkQalQSLDW-EAJxbqQOqGbR6FCdDQnOg Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:47:42.602546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:47:42.604027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/40540f8322a54133bc32e1af000810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_40540f8322a54133bc32e1af000810ad", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:47:42.604027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:47:42.604027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:47:42.604027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:47:42.604027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:47:42.604027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:47:42.604027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:47:42.604027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 956aff831fa04d29ba5cffb88e73f4d2 Aug 03 10:47:42.604027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:47:42.604027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:47:42.604027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. Aug 03 10:47:42.604027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': 'b6a399a7-91eb-41c8-b408-c5df154a36cc'} Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:47:42.604793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. Aug 03 10:47:42.605994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:47:42.607057 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f24bfa18-570e-46ba-9d95-8fb4d65b4662 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Returning 404 to user: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:47:42.607057 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f24bfa18-570e-46ba-9d95-8fb4d65b4662 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 404 len: 111 microversion: 2.1 time: 0.037073 Aug 03 10:47:42.607057 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 253/494] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:42 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:47:42.613617 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-15256238-b5bd-4ff8-8fcb-80c9778df5cc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '.version_select at 0x7fbd105525e0>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:42.637128 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-15256238-b5bd-4ff8-8fcb-80c9778df5cc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1166748933" status: 202 len: 0 microversion: 2.1 time: 0.027719 Aug 03 10:47:42.637764 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 242/495] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Aug 3 10:47:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1166748933 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 10:47:43.042154 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e25f5005-3deb-40a6-b10c-44e2fa57e9a5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:43.043140 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e25f5005-3deb-40a6-b10c-44e2fa57e9a5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:43.049370 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e25f5005-3deb-40a6-b10c-44e2fa57e9a5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:43.050171 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e25f5005-3deb-40a6-b10c-44e2fa57e9a5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:43.051016 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e25f5005-3deb-40a6-b10c-44e2fa57e9a5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:43.052218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e25f5005-3deb-40a6-b10c-44e2fa57e9a5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:43.270842 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e25f5005-3deb-40a6-b10c-44e2fa57e9a5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:43.278535 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e25f5005-3deb-40a6-b10c-44e2fa57e9a5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1664 microversion: 2.1 time: 0.240258 Aug 03 10:47:43.279216 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 254/496] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:43 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1664 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:43.543383 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-adc6c842-58e3-483f-8224-95288f99d2cd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Action: 'create', calling method: .version_select at 0x7fbd105af0d0>, body: {"keypair": {"name": "tempest-keypair-1882944244", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSxRG7xprxxFl9RRM2xZmn/2OY+pFmNWTR6Zcm+23AgyX4ve/CvMG3Xvh//x5kc9MDirUd7li5PqibtZjR4K6F3EEWNKiFtYYEkgjgtuNl82rkdMtyjNcmXXWNWQ1HTXw=="}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:47:43.560082 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-adc6c842-58e3-483f-8224-95288f99d2cd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for project 40540f8322a54133bc32e1af000810ad. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:47:43.564032 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-adc6c842-58e3-483f-8224-95288f99d2cd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for user 956aff831fa04d29ba5cffb88e73f4d2 and project 40540f8322a54133bc32e1af000810ad. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:47:43.591394 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-adc6c842-58e3-483f-8224-95288f99d2cd tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052462 Aug 03 10:47:43.592012 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 243/497] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 3 10:47:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:47:44.301603 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4d0c42ac-c71c-42fb-99e9-04e2710068a3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:44.302265 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4d0c42ac-c71c-42fb-99e9-04e2710068a3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:44.309447 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4d0c42ac-c71c-42fb-99e9-04e2710068a3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:44.310225 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4d0c42ac-c71c-42fb-99e9-04e2710068a3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:44.311134 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4d0c42ac-c71c-42fb-99e9-04e2710068a3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:44.311571 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4d0c42ac-c71c-42fb-99e9-04e2710068a3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:44.559250 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4d0c42ac-c71c-42fb-99e9-04e2710068a3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:44.573064 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4d0c42ac-c71c-42fb-99e9-04e2710068a3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1668 microversion: 2.1 time: 0.276197 Aug 03 10:47:44.574566 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 255/498] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:44 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1668 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:45.162771 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1121323442", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42fc3d27-55c9-4201-9ee3-9a52a8c6af61"}], "security_groups": [{"name": "tempest-securitygroup--200005934"}], "key_name": "tempest-keypair-1882944244", "user_data": "}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:47:45.272275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.network.neutron [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] validate_networks() for [('42fc3d27-55c9-4201-9ee3-9a52a8c6af61', None, None, None, None, None)] {{(pid=124389) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:47:45.640405 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Flavor limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:47:45.640828 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Image limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:47:45.641335 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Flavor pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:47:45.641780 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Image pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:47:45.642190 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:47:45.651216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:45.651658 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:45.652449 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:45.652882 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:45.670673 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for project 40540f8322a54133bc32e1af000810ad. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:47:45.674856 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for user 956aff831fa04d29ba5cffb88e73f4d2 and project 40540f8322a54133bc32e1af000810ad. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:47:45.687930 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Going to run 1 instances... {{(pid=124389) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:47:45.690236 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:47:45.739950 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-6e64e17d-cf88-48ab-a731-3986a82ec529 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.582117 Aug 03 10:47:45.740779 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 244/499] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:47:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 10:47:45.752048 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-490c393e-3eb5-443a-bbea-21a09bc60ce2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:45.752800 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-490c393e-3eb5-443a-bbea-21a09bc60ce2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:45.810066 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-490c393e-3eb5-443a-bbea-21a09bc60ce2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:45.827140 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-490c393e-3eb5-443a-bbea-21a09bc60ce2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1242 microversion: 2.1 time: 0.079364 Aug 03 10:47:45.827717 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 256/500] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:45 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:45.849070 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b442094b-27b7-4fe9-97be-3517c90fe166 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:45.850164 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b442094b-27b7-4fe9-97be-3517c90fe166 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:45.865216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b442094b-27b7-4fe9-97be-3517c90fe166 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:45.869298 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b442094b-27b7-4fe9-97be-3517c90fe166 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:45.871425 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b442094b-27b7-4fe9-97be-3517c90fe166 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:45.873292 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b442094b-27b7-4fe9-97be-3517c90fe166 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:45.979201 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-b442094b-27b7-4fe9-97be-3517c90fe166 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lazy-loading 'services' on Instance uuid 476109cf-f3fe-42cd-b1dd-aadbe1c56a52 {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:47:46.073428 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b442094b-27b7-4fe9-97be-3517c90fe166 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "DELETE /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52/os-volume_attachments/c980f0a4-8bd4-42b7-a4d8-e8442ebf73f7" status: 202 len: 0 microversion: 2.1 time: 0.233483 Aug 03 10:47:46.074081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 245/501] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 3 10:47:45 2022] DELETE /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52/os-volume_attachments/c980f0a4-8bd4-42b7-a4d8-e8442ebf73f7 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 10:47:46.849390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4bade43f-0735-4e84-91e3-7e602592d316 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:46.854023 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4bade43f-0735-4e84-91e3-7e602592d316 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:46.862495 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4bade43f-0735-4e84-91e3-7e602592d316 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:46.863327 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4bade43f-0735-4e84-91e3-7e602592d316 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:46.864809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4bade43f-0735-4e84-91e3-7e602592d316 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:46.865266 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4bade43f-0735-4e84-91e3-7e602592d316 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:46.930760 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4bade43f-0735-4e84-91e3-7e602592d316 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:46.939130 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4bade43f-0735-4e84-91e3-7e602592d316 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1294 microversion: 2.1 time: 0.094820 Aug 03 10:47:46.940363 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 257/502] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:46 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:47.240703 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6bd01adc-f199-4e6e-8224-29cf70321f7a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:47.241311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6bd01adc-f199-4e6e-8224-29cf70321f7a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:47.251076 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6bd01adc-f199-4e6e-8224-29cf70321f7a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:47.251518 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6bd01adc-f199-4e6e-8224-29cf70321f7a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:47.252771 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6bd01adc-f199-4e6e-8224-29cf70321f7a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:47.253274 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6bd01adc-f199-4e6e-8224-29cf70321f7a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:47.281419 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6bd01adc-f199-4e6e-8224-29cf70321f7a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Going to try to terminate instance {{(pid=124389) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:47:47.398416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-6bd01adc-f199-4e6e-8224-29cf70321f7a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "DELETE /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 204 len: 0 microversion: 2.1 time: 0.162516 Aug 03 10:47:47.399663 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 246/503] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:47:47 2022] DELETE /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:47:47.409156 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3c9c2b34-5654-4cb4-a266-07212c9df06d tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:47.409689 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3c9c2b34-5654-4cb4-a266-07212c9df06d tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:47.419853 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3c9c2b34-5654-4cb4-a266-07212c9df06d tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:47.420315 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3c9c2b34-5654-4cb4-a266-07212c9df06d tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:47.421093 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3c9c2b34-5654-4cb4-a266-07212c9df06d tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:47.421722 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3c9c2b34-5654-4cb4-a266-07212c9df06d tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:47.597953 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3c9c2b34-5654-4cb4-a266-07212c9df06d tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:47.600908 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:47:47.607921 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3c9c2b34-5654-4cb4-a266-07212c9df06d tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1515 microversion: 2.1 time: 0.203280 Aug 03 10:47:47.608487 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 258/504] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:47 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1515 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:47.961988 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-66defee9-ecfd-441a-aebe-af6073b00bbf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:47.962677 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-66defee9-ecfd-441a-aebe-af6073b00bbf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:47.968562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-66defee9-ecfd-441a-aebe-af6073b00bbf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:47.969129 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-66defee9-ecfd-441a-aebe-af6073b00bbf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:47.969778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-66defee9-ecfd-441a-aebe-af6073b00bbf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:47.970203 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-66defee9-ecfd-441a-aebe-af6073b00bbf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:48.035884 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-66defee9-ecfd-441a-aebe-af6073b00bbf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:48.043789 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-66defee9-ecfd-441a-aebe-af6073b00bbf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1312 microversion: 2.1 time: 0.086600 Aug 03 10:47:48.044379 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 247/505] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:47 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1312 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:48.631720 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-40e8ce63-761c-4714-9994-80bc75c736ae tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:48.632307 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-40e8ce63-761c-4714-9994-80bc75c736ae tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:48.638967 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40e8ce63-761c-4714-9994-80bc75c736ae tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:48.639397 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40e8ce63-761c-4714-9994-80bc75c736ae tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:48.640154 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40e8ce63-761c-4714-9994-80bc75c736ae tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:48.640629 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40e8ce63-761c-4714-9994-80bc75c736ae tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:48.783372 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-40e8ce63-761c-4714-9994-80bc75c736ae tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:48.791927 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-40e8ce63-761c-4714-9994-80bc75c736ae tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1515 microversion: 2.1 time: 0.164603 Aug 03 10:47:48.792528 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 259/506] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:48 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:48.923572 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1472413984", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452"}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:47:48.976705 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.network.neutron [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] validate_networks() for None {{(pid=124389) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:47:49.066282 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9561a13c-bf1e-4635-a43b-6b179d014442 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:49.067352 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9561a13c-bf1e-4635-a43b-6b179d014442 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:49.074367 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9561a13c-bf1e-4635-a43b-6b179d014442 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:49.074907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9561a13c-bf1e-4635-a43b-6b179d014442 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:49.075788 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9561a13c-bf1e-4635-a43b-6b179d014442 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:49.076294 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9561a13c-bf1e-4635-a43b-6b179d014442 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:49.174057 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9561a13c-bf1e-4635-a43b-6b179d014442 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:49.190650 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9561a13c-bf1e-4635-a43b-6b179d014442 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1300 microversion: 2.1 time: 0.128806 Aug 03 10:47:49.191234 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 260/507] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:49 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1300 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:47:49.289175 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Flavor limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:47:49.289735 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Image limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:47:49.290309 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Flavor pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:47:49.290816 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Image pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:47:49.291325 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:47:49.300538 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:49.301127 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:49.301998 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:49.302501 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:49.320055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Getting quotas for project 79ec0038f90e431dbe8ac58bf109e259. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:47:49.324116 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Getting quotas for user ea2b889e606f453e8fd5bc0710072fa6 and project 79ec0038f90e431dbe8ac58bf109e259. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:47:49.336100 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Going to run 1 instances... {{(pid=124389) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:47:49.338695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:47:49.382587 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-884e9dbf-16f4-48b9-934b-f7fcbc0e49a5 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.462814 Aug 03 10:47:49.383486 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 248/508] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:47:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:47:49.394532 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-45ac8c8e-108c-4a87-916c-14e4a07ccaf6 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:49.394829 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-45ac8c8e-108c-4a87-916c-14e4a07ccaf6 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:49.397277 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:47:49.452090 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-45ac8c8e-108c-4a87-916c-14e4a07ccaf6 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:49.460603 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-45ac8c8e-108c-4a87-916c-14e4a07ccaf6 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1215 microversion: 2.1 time: 0.070064 Aug 03 10:47:49.474209 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 261/509] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:49 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:49.815831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-46827b51-7b52-4c5c-b420-abf62ef5e803 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:49.818455 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-46827b51-7b52-4c5c-b420-abf62ef5e803 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:49.830230 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-46827b51-7b52-4c5c-b420-abf62ef5e803 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:49.830795 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-46827b51-7b52-4c5c-b420-abf62ef5e803 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:49.831998 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-46827b51-7b52-4c5c-b420-abf62ef5e803 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:49.832561 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-46827b51-7b52-4c5c-b420-abf62ef5e803 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:49.850839 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:47:50.023528 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-46827b51-7b52-4c5c-b420-abf62ef5e803 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:50.037022 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-46827b51-7b52-4c5c-b420-abf62ef5e803 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 200 len: 1515 microversion: 2.1 time: 0.225492 Aug 03 10:47:50.038044 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 249/510] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:49 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 1515 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:50.181771 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-ad8294eb-417e-4a07-965e-83db081b1676 req-ff902162-4be0-4adb-841a-b6a5c5c6dea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476109cf-f3fe-42cd-b1dd-aadbe1c56a52", "name": "network-vif-deleted", "tag": "075ed4cf-bf99-45c6-b995-b90ac6821b48"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:47:50.206318 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-ad8294eb-417e-4a07-965e-83db081b1676 req-ff902162-4be0-4adb-841a-b6a5c5c6dea4 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:50.207180 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-ad8294eb-417e-4a07-965e-83db081b1676 req-ff902162-4be0-4adb-841a-b6a5c5c6dea4 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:50.212487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a90cd1a2-6244-4d26-91a3-5df67438e28e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:50.213392 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-a90cd1a2-6244-4d26-91a3-5df67438e28e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:50.234429 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a90cd1a2-6244-4d26-91a3-5df67438e28e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:50.235241 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a90cd1a2-6244-4d26-91a3-5df67438e28e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:50.236503 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a90cd1a2-6244-4d26-91a3-5df67438e28e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:50.237029 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a90cd1a2-6244-4d26-91a3-5df67438e28e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:50.240163 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-ad8294eb-417e-4a07-965e-83db081b1676 req-ff902162-4be0-4adb-841a-b6a5c5c6dea4 service nova] Creating event network-vif-deleted:075ed4cf-bf99-45c6-b995-b90ac6821b48 for instance 476109cf-f3fe-42cd-b1dd-aadbe1c56a52 on hv-cinder-85083 Aug 03 10:47:50.252556 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-ad8294eb-417e-4a07-965e-83db081b1676 req-ff902162-4be0-4adb-841a-b6a5c5c6dea4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094398 Aug 03 10:47:50.253890 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 262/511] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:47:50.417674 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-a90cd1a2-6244-4d26-91a3-5df67438e28e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:50.425794 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-a90cd1a2-6244-4d26-91a3-5df67438e28e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1367 microversion: 2.1 time: 0.217012 Aug 03 10:47:50.426450 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 250/512] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:50 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:50.484394 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1470bfcd-1d4e-4b90-9247-136c5a149923 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:50.485097 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1470bfcd-1d4e-4b90-9247-136c5a149923 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:50.491880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1470bfcd-1d4e-4b90-9247-136c5a149923 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:50.492322 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1470bfcd-1d4e-4b90-9247-136c5a149923 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:50.493224 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1470bfcd-1d4e-4b90-9247-136c5a149923 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:50.493536 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1470bfcd-1d4e-4b90-9247-136c5a149923 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:50.565251 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1470bfcd-1d4e-4b90-9247-136c5a149923 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:50.578872 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1470bfcd-1d4e-4b90-9247-136c5a149923 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1267 microversion: 2.1 time: 0.100594 Aug 03 10:47:50.594086 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 263/513] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:50 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:51.072170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-669339ae-2739-417d-92bd-8a1d6b71e4d2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:51.072881 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-669339ae-2739-417d-92bd-8a1d6b71e4d2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: 476109cf-f3fe-42cd-b1dd-aadbe1c56a52] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:51.081709 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-669339ae-2739-417d-92bd-8a1d6b71e4d2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:51.082507 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-669339ae-2739-417d-92bd-8a1d6b71e4d2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:51.084190 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-669339ae-2739-417d-92bd-8a1d6b71e4d2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:51.084960 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-669339ae-2739-417d-92bd-8a1d6b71e4d2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:51.102778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-669339ae-2739-417d-92bd-8a1d6b71e4d2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] HTTP exception thrown: Instance 476109cf-f3fe-42cd-b1dd-aadbe1c56a52 could not be found. Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-669339ae-2739-417d-92bd-8a1d6b71e4d2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Request method failure captured: Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 HTTP/1.1 Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lIFXLkzCONBalgaATFLgV2HGjPWPp5gWFJZho0uVR-f7-BM3pO7WVtbXRaqvU3a1tQkKFwnIRSAq-QCQ5HzTS6myN3OdPl68RpFqJgOcj8xTY0cPuLAKVjiZ_KGEbCwyiM210rwbZgmbiDl5U2Hkbtj3WYix2N7Asulqu1ceiY4C64 Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: f9d4304db6d342e4ada925b6784e6d0d Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-VolumesSnapshotTestJSON-10231931 Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:47:51.104442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:47:51.105958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9d4304db6d342e4ada925b6784e6d0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f9d4304db6d342e4ada925b6784e6d0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9d4304db6d342e4ada925b6784e6d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f9d4304db6d342e4ada925b6784e6d0d", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:47:51.105958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-VolumesSnapshotTestJSON-10231931 Aug 03 10:47:51.105958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: f9d4304db6d342e4ada925b6784e6d0d Aug 03 10:47:51.105958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-10231931 Aug 03 10:47:51.105958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-VolumesSnapshotTestJSON-10231931-project Aug 03 10:47:51.105958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:47:51.105958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:47:51.105958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 92485e486d53488eabf12105d1048e13 Aug 03 10:47:51.105958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-VolumesSnapshotTestJSON-10231931-project Aug 03 10:47:51.105958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:47:51.105958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 476109cf-f3fe-42cd-b1dd-aadbe1c56a52 could not be found. Aug 03 10:47:51.105958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '476109cf-f3fe-42cd-b1dd-aadbe1c56a52'} Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 476109cf-f3fe-42cd-b1dd-aadbe1c56a52 could not be found. Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:47:51.106887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 476109cf-f3fe-42cd-b1dd-aadbe1c56a52 could not be found. Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 476109cf-f3fe-42cd-b1dd-aadbe1c56a52 could not be found. Aug 03 10:47:51.108437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:47:51.109799 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-669339ae-2739-417d-92bd-8a1d6b71e4d2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Returning 404 to user: Instance 476109cf-f3fe-42cd-b1dd-aadbe1c56a52 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:47:51.109799 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-669339ae-2739-417d-92bd-8a1d6b71e4d2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52" status: 404 len: 111 microversion: 2.1 time: 0.039354 Aug 03 10:47:51.110750 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 251/514] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:51 2022] GET /compute/v2.1/servers/476109cf-f3fe-42cd-b1dd-aadbe1c56a52 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:47:51.446864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-311eb04e-accd-4368-8a38-dd24efd251d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:51.447591 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-311eb04e-accd-4368-8a38-dd24efd251d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:51.453761 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-311eb04e-accd-4368-8a38-dd24efd251d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:51.454209 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-311eb04e-accd-4368-8a38-dd24efd251d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:51.454985 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-311eb04e-accd-4368-8a38-dd24efd251d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:51.455421 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-311eb04e-accd-4368-8a38-dd24efd251d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:51.588473 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-311eb04e-accd-4368-8a38-dd24efd251d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:51.596500 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-311eb04e-accd-4368-8a38-dd24efd251d4 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1367 microversion: 2.1 time: 0.153404 Aug 03 10:47:51.597357 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 264/515] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:51 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:47:51.601098 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-f6364018-17a4-4125-a9cf-8073de90d822 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:51.601883 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-f6364018-17a4-4125-a9cf-8073de90d822 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:51.608206 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f6364018-17a4-4125-a9cf-8073de90d822 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:51.608803 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f6364018-17a4-4125-a9cf-8073de90d822 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:51.609707 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f6364018-17a4-4125-a9cf-8073de90d822 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:51.610246 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f6364018-17a4-4125-a9cf-8073de90d822 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:51.675282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f6364018-17a4-4125-a9cf-8073de90d822 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:51.684863 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-f6364018-17a4-4125-a9cf-8073de90d822 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1273 microversion: 2.1 time: 0.088529 Aug 03 10:47:51.685791 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 252/516] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:51 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:52.268681 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-1d8116bc-fdcd-4d2d-a7ae-fe7502ea2960 req-ae78a7ec-4a36-439e-84bc-5aa48a2043b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "848ceec4-9b34-4e0f-a57e-95de02097455", "tag": "9cba26e5-f3cf-4c00-8b87-69db9302e407"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:47:52.279075 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-1d8116bc-fdcd-4d2d-a7ae-fe7502ea2960 req-ae78a7ec-4a36-439e-84bc-5aa48a2043b9 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:52.279567 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-1d8116bc-fdcd-4d2d-a7ae-fe7502ea2960 req-ae78a7ec-4a36-439e-84bc-5aa48a2043b9 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:52.290749 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-1d8116bc-fdcd-4d2d-a7ae-fe7502ea2960 req-ae78a7ec-4a36-439e-84bc-5aa48a2043b9 service nova] Creating event network-changed:9cba26e5-f3cf-4c00-8b87-69db9302e407 for instance 848ceec4-9b34-4e0f-a57e-95de02097455 on hv-cinder-85083 Aug 03 10:47:52.295444 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-1d8116bc-fdcd-4d2d-a7ae-fe7502ea2960 req-ae78a7ec-4a36-439e-84bc-5aa48a2043b9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030427 Aug 03 10:47:52.296025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 265/517] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:47:52.619787 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e554e1c4-4007-4e96-865d-e1f3a3908ea2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:52.620306 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e554e1c4-4007-4e96-865d-e1f3a3908ea2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:52.626914 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e554e1c4-4007-4e96-865d-e1f3a3908ea2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:52.627360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e554e1c4-4007-4e96-865d-e1f3a3908ea2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:52.628109 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e554e1c4-4007-4e96-865d-e1f3a3908ea2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:52.628542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e554e1c4-4007-4e96-865d-e1f3a3908ea2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:52.706338 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-884f3a0e-5cfb-433a-ac8d-3cf105f67b68 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:52.706858 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-884f3a0e-5cfb-433a-ac8d-3cf105f67b68 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:52.713071 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-884f3a0e-5cfb-433a-ac8d-3cf105f67b68 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:52.713552 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-884f3a0e-5cfb-433a-ac8d-3cf105f67b68 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:52.714311 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-884f3a0e-5cfb-433a-ac8d-3cf105f67b68 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:52.714773 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-884f3a0e-5cfb-433a-ac8d-3cf105f67b68 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:52.767135 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e554e1c4-4007-4e96-865d-e1f3a3908ea2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:52.774594 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e554e1c4-4007-4e96-865d-e1f3a3908ea2 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1367 microversion: 2.1 time: 0.159795 Aug 03 10:47:52.775155 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 253/518] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:52 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:52.852095 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-884f3a0e-5cfb-433a-ac8d-3cf105f67b68 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:52.859447 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-884f3a0e-5cfb-433a-ac8d-3cf105f67b68 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1315 microversion: 2.1 time: 0.157487 Aug 03 10:47:52.860007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 266/519] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:52 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:53.795906 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-be4e3dd9-213a-4dcb-bc69-70b9125582ad tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:53.796535 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-be4e3dd9-213a-4dcb-bc69-70b9125582ad tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:53.803000 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-be4e3dd9-213a-4dcb-bc69-70b9125582ad tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:53.803440 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-be4e3dd9-213a-4dcb-bc69-70b9125582ad tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:53.804189 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-be4e3dd9-213a-4dcb-bc69-70b9125582ad tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:53.804621 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-be4e3dd9-213a-4dcb-bc69-70b9125582ad tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:53.880555 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3509039a-5f95-4b54-b870-f89c74c9f429 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:53.881199 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3509039a-5f95-4b54-b870-f89c74c9f429 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:53.887226 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3509039a-5f95-4b54-b870-f89c74c9f429 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:53.887665 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3509039a-5f95-4b54-b870-f89c74c9f429 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:53.888427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3509039a-5f95-4b54-b870-f89c74c9f429 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:53.888853 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3509039a-5f95-4b54-b870-f89c74c9f429 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:53.940579 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-be4e3dd9-213a-4dcb-bc69-70b9125582ad tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:53.948792 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-be4e3dd9-213a-4dcb-bc69-70b9125582ad tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1367 microversion: 2.1 time: 0.156818 Aug 03 10:47:53.949360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 254/520] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:53 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:54.023938 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3509039a-5f95-4b54-b870-f89c74c9f429 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:54.031305 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3509039a-5f95-4b54-b870-f89c74c9f429 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1315 microversion: 2.1 time: 0.155034 Aug 03 10:47:54.031862 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 267/521] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:53 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:47:54.737320 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-d829c1f5-c4f2-424d-9dc3-02eecfd5cdc0 req-ecd4afb0-ec65-49c6-8888-991667133603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98aeac07-2781-469a-a225-0757dce112d0", "tag": "778085bd-4ffa-401f-9b01-bcf86a0bb85a"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:47:54.747281 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-d829c1f5-c4f2-424d-9dc3-02eecfd5cdc0 req-ecd4afb0-ec65-49c6-8888-991667133603 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:54.747727 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-d829c1f5-c4f2-424d-9dc3-02eecfd5cdc0 req-ecd4afb0-ec65-49c6-8888-991667133603 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:54.760870 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-d829c1f5-c4f2-424d-9dc3-02eecfd5cdc0 req-ecd4afb0-ec65-49c6-8888-991667133603 service nova] Creating event network-changed:778085bd-4ffa-401f-9b01-bcf86a0bb85a for instance 98aeac07-2781-469a-a225-0757dce112d0 on hv-cinder-85083 Aug 03 10:47:54.766294 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-d829c1f5-c4f2-424d-9dc3-02eecfd5cdc0 req-ecd4afb0-ec65-49c6-8888-991667133603 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034539 Aug 03 10:47:54.766965 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 255/522] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:47:54.969728 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0f60f4c8-f570-4805-a587-dd585da5b538 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:54.970251 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0f60f4c8-f570-4805-a587-dd585da5b538 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:54.976932 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0f60f4c8-f570-4805-a587-dd585da5b538 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:54.977381 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0f60f4c8-f570-4805-a587-dd585da5b538 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:54.978175 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0f60f4c8-f570-4805-a587-dd585da5b538 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:54.978610 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0f60f4c8-f570-4805-a587-dd585da5b538 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:55.053020 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-dd54ad99-0c2f-4792-be12-ebf844a8f369 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:55.053781 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-dd54ad99-0c2f-4792-be12-ebf844a8f369 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:55.060604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dd54ad99-0c2f-4792-be12-ebf844a8f369 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:55.061062 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dd54ad99-0c2f-4792-be12-ebf844a8f369 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:55.061874 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dd54ad99-0c2f-4792-be12-ebf844a8f369 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:55.062308 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dd54ad99-0c2f-4792-be12-ebf844a8f369 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:55.121607 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0f60f4c8-f570-4805-a587-dd585da5b538 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:55.129215 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0f60f4c8-f570-4805-a587-dd585da5b538 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1367 microversion: 2.1 time: 0.163389 Aug 03 10:47:55.130325 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 268/523] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:54 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:55.209966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-dd54ad99-0c2f-4792-be12-ebf844a8f369 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:55.220230 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-dd54ad99-0c2f-4792-be12-ebf844a8f369 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1315 microversion: 2.1 time: 0.171798 Aug 03 10:47:55.220656 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 256/524] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:55 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:47:56.150808 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5f130fd8-f0a0-4dcb-8a8a-0e47d405e8d1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:56.151418 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5f130fd8-f0a0-4dcb-8a8a-0e47d405e8d1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:56.157382 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5f130fd8-f0a0-4dcb-8a8a-0e47d405e8d1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:56.157857 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5f130fd8-f0a0-4dcb-8a8a-0e47d405e8d1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:56.158620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5f130fd8-f0a0-4dcb-8a8a-0e47d405e8d1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:56.159046 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5f130fd8-f0a0-4dcb-8a8a-0e47d405e8d1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:56.241595 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ee658336-23e3-41c9-9a91-9177b0c2f6ba tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:56.242868 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-ee658336-23e3-41c9-9a91-9177b0c2f6ba tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:56.248985 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ee658336-23e3-41c9-9a91-9177b0c2f6ba tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:56.249435 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ee658336-23e3-41c9-9a91-9177b0c2f6ba tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:56.250297 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ee658336-23e3-41c9-9a91-9177b0c2f6ba tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:56.250760 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ee658336-23e3-41c9-9a91-9177b0c2f6ba tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:56.308134 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5f130fd8-f0a0-4dcb-8a8a-0e47d405e8d1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:56.316617 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5f130fd8-f0a0-4dcb-8a8a-0e47d405e8d1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1367 microversion: 2.1 time: 0.169490 Aug 03 10:47:56.317822 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 269/525] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:56 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:56.408112 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-ee658336-23e3-41c9-9a91-9177b0c2f6ba tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:56.415544 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ee658336-23e3-41c9-9a91-9177b0c2f6ba tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1315 microversion: 2.1 time: 0.178488 Aug 03 10:47:56.416106 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 257/526] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:56 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:47:57.340588 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-07ee23c9-d4b1-416c-8282-a0a8b5b9decf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:57.341203 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-07ee23c9-d4b1-416c-8282-a0a8b5b9decf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:57.348061 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-07ee23c9-d4b1-416c-8282-a0a8b5b9decf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:57.349033 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-07ee23c9-d4b1-416c-8282-a0a8b5b9decf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:57.349854 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-07ee23c9-d4b1-416c-8282-a0a8b5b9decf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:57.350292 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-07ee23c9-d4b1-416c-8282-a0a8b5b9decf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:57.438486 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-40f13394-3f5b-4d76-bf4b-64df58af9e84 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:57.439109 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-40f13394-3f5b-4d76-bf4b-64df58af9e84 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:57.446757 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-40f13394-3f5b-4d76-bf4b-64df58af9e84 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:57.447209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-40f13394-3f5b-4d76-bf4b-64df58af9e84 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:57.448072 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-40f13394-3f5b-4d76-bf4b-64df58af9e84 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:57.448427 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-40f13394-3f5b-4d76-bf4b-64df58af9e84 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:57.502647 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-07ee23c9-d4b1-416c-8282-a0a8b5b9decf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:57.510800 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-07ee23c9-d4b1-416c-8282-a0a8b5b9decf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1367 microversion: 2.1 time: 0.174087 Aug 03 10:47:57.511367 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 270/527] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:57 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:57.587478 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-40f13394-3f5b-4d76-bf4b-64df58af9e84 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:57.595089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-40f13394-3f5b-4d76-bf4b-64df58af9e84 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1315 microversion: 2.1 time: 0.160734 Aug 03 10:47:57.595604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 258/528] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:57 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:58.532170 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-66055fe7-71f0-4896-892e-15581306a70d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:58.532787 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-66055fe7-71f0-4896-892e-15581306a70d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:58.540517 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-66055fe7-71f0-4896-892e-15581306a70d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:58.541095 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-66055fe7-71f0-4896-892e-15581306a70d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:58.541905 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-66055fe7-71f0-4896-892e-15581306a70d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:58.542354 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-66055fe7-71f0-4896-892e-15581306a70d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:58.616811 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e9fc0623-7f49-4adc-83be-2a1ec88c79e4 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:58.618097 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e9fc0623-7f49-4adc-83be-2a1ec88c79e4 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:58.624701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e9fc0623-7f49-4adc-83be-2a1ec88c79e4 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:58.625148 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e9fc0623-7f49-4adc-83be-2a1ec88c79e4 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:58.626117 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e9fc0623-7f49-4adc-83be-2a1ec88c79e4 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:58.626551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e9fc0623-7f49-4adc-83be-2a1ec88c79e4 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:58.720675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-66055fe7-71f0-4896-892e-15581306a70d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:58.729009 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-66055fe7-71f0-4896-892e-15581306a70d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1367 microversion: 2.1 time: 0.200587 Aug 03 10:47:58.729629 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 271/529] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:58 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:47:58.792965 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e9fc0623-7f49-4adc-83be-2a1ec88c79e4 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:58.800399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e9fc0623-7f49-4adc-83be-2a1ec88c79e4 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1315 microversion: 2.1 time: 0.188108 Aug 03 10:47:58.800969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 259/530] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:58 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:47:59.477221 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-e8147804-ae35-4c79-a755-ec5c4b96eb5b req-604a5bde-807d-4517-b3cb-64aac7c0358d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "848ceec4-9b34-4e0f-a57e-95de02097455", "name": "network-vif-plugged", "status": "completed", "tag": "9cba26e5-f3cf-4c00-8b87-69db9302e407"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:47:59.482125 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=4 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:47:59.490695 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e8147804-ae35-4c79-a755-ec5c4b96eb5b req-604a5bde-807d-4517-b3cb-64aac7c0358d service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:59.491046 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e8147804-ae35-4c79-a755-ec5c4b96eb5b req-604a5bde-807d-4517-b3cb-64aac7c0358d service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:59.504334 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-e8147804-ae35-4c79-a755-ec5c4b96eb5b req-604a5bde-807d-4517-b3cb-64aac7c0358d service nova] Creating event network-vif-plugged:9cba26e5-f3cf-4c00-8b87-69db9302e407 for instance 848ceec4-9b34-4e0f-a57e-95de02097455 on hv-cinder-85083 Aug 03 10:47:59.510501 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-e8147804-ae35-4c79-a755-ec5c4b96eb5b req-604a5bde-807d-4517-b3cb-64aac7c0358d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036938 Aug 03 10:47:59.511099 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 272/531] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:47:59.749993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b9f43e17-b109-46b3-bc05-8b2967d03dba tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:59.750627 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b9f43e17-b109-46b3-bc05-8b2967d03dba tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:59.752574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=4 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:47:59.753357 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=16 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:47:59.759846 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b9f43e17-b109-46b3-bc05-8b2967d03dba tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:59.760294 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b9f43e17-b109-46b3-bc05-8b2967d03dba tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:59.761066 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b9f43e17-b109-46b3-bc05-8b2967d03dba tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:59.761524 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b9f43e17-b109-46b3-bc05-8b2967d03dba tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:59.821302 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-568139ac-03fd-4c2b-89f5-ae8731145079 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:47:59.822087 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-568139ac-03fd-4c2b-89f5-ae8731145079 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:47:59.828413 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-568139ac-03fd-4c2b-89f5-ae8731145079 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:59.828864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-568139ac-03fd-4c2b-89f5-ae8731145079 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:59.829686 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-568139ac-03fd-4c2b-89f5-ae8731145079 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:47:59.830115 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-568139ac-03fd-4c2b-89f5-ae8731145079 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:47:59.936491 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b9f43e17-b109-46b3-bc05-8b2967d03dba tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:47:59.944448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b9f43e17-b109-46b3-bc05-8b2967d03dba tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1367 microversion: 2.1 time: 0.198185 Aug 03 10:47:59.945023 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 260/532] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:59 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:00.006004 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-568139ac-03fd-4c2b-89f5-ae8731145079 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:00.012309 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-568139ac-03fd-4c2b-89f5-ae8731145079 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1315 microversion: 2.1 time: 0.195287 Aug 03 10:48:00.013083 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 273/533] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:47:59 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:48:00.192405 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1961084767", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "networks": [{"uuid": "7bee7923-de26-4c18-a8da-7229c320396a"}]}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:00.200141 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:00.247331 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.network.neutron [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] validate_networks() for [('7bee7923-de26-4c18-a8da-7229c320396a', None, None, None, None, None)] {{(pid=124389) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:48:00.607172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Flavor limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:48:00.607590 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Image limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:48:00.608090 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Flavor pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:48:00.608493 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Image pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:48:00.608899 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:48:00.618288 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:00.618731 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:00.619519 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:00.619947 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:00.637067 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Getting quotas for project f9d4304db6d342e4ada925b6784e6d0d. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:48:00.640987 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Getting quotas for user 92485e486d53488eabf12105d1048e13 and project f9d4304db6d342e4ada925b6784e6d0d. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:48:00.654993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Going to run 1 instances... {{(pid=124389) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:48:00.657278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:48:00.707319 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-54685b30-3860-4268-b0b6-f920ff7654e2 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517862 Aug 03 10:48:00.707319 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 261/534] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:48:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:48:00.718640 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b7c9736b-0632-4db3-b9ae-127a8b9106c9 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:00.719247 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b7c9736b-0632-4db3-b9ae-127a8b9106c9 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:00.773421 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b7c9736b-0632-4db3-b9ae-127a8b9106c9 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:00.779965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b7c9736b-0632-4db3-b9ae-127a8b9106c9 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1219 microversion: 2.1 time: 0.065183 Aug 03 10:48:00.780723 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 274/535] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:00 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:00.968682 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c49026ae-7cca-4588-b528-31aee431cf4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:00.969569 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-c49026ae-7cca-4588-b528-31aee431cf4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:00.979163 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c49026ae-7cca-4588-b528-31aee431cf4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:00.979611 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c49026ae-7cca-4588-b528-31aee431cf4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:00.980501 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c49026ae-7cca-4588-b528-31aee431cf4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:00.980941 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c49026ae-7cca-4588-b528-31aee431cf4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:01.054725 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ecb7349c-96bd-47c3-9eb1-5c4b7fb55952 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:01.055969 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ecb7349c-96bd-47c3-9eb1-5c4b7fb55952 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:01.067448 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ecb7349c-96bd-47c3-9eb1-5c4b7fb55952 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:01.070064 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ecb7349c-96bd-47c3-9eb1-5c4b7fb55952 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:01.070903 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ecb7349c-96bd-47c3-9eb1-5c4b7fb55952 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:01.071381 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ecb7349c-96bd-47c3-9eb1-5c4b7fb55952 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:01.142939 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c49026ae-7cca-4588-b528-31aee431cf4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:01.151215 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c49026ae-7cca-4588-b528-31aee431cf4a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1367 microversion: 2.1 time: 0.186641 Aug 03 10:48:01.151801 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 262/536] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:00 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:01.238292 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ecb7349c-96bd-47c3-9eb1-5c4b7fb55952 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:01.246650 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ecb7349c-96bd-47c3-9eb1-5c4b7fb55952 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1315 microversion: 2.1 time: 0.199776 Aug 03 10:48:01.247207 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 275/537] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:01 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:01.800207 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-bf8ec35e-c360-435a-89b0-a2099a57e15a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:01.800853 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-bf8ec35e-c360-435a-89b0-a2099a57e15a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:01.807186 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bf8ec35e-c360-435a-89b0-a2099a57e15a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:01.807645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bf8ec35e-c360-435a-89b0-a2099a57e15a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:01.808482 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bf8ec35e-c360-435a-89b0-a2099a57e15a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:01.809403 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bf8ec35e-c360-435a-89b0-a2099a57e15a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:01.880415 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-bf8ec35e-c360-435a-89b0-a2099a57e15a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:01.890395 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-bf8ec35e-c360-435a-89b0-a2099a57e15a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1271 microversion: 2.1 time: 0.093817 Aug 03 10:48:01.891611 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 263/538] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:01 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:02.172858 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f10d16eb-693d-434c-86ac-3a53619a52e8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:02.173531 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f10d16eb-693d-434c-86ac-3a53619a52e8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:02.179592 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f10d16eb-693d-434c-86ac-3a53619a52e8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:02.180042 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f10d16eb-693d-434c-86ac-3a53619a52e8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:02.180811 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f10d16eb-693d-434c-86ac-3a53619a52e8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:02.181238 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f10d16eb-693d-434c-86ac-3a53619a52e8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:02.267514 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-cc483609-de41-46f5-b3a9-668d91472f7c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:02.268118 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-cc483609-de41-46f5-b3a9-668d91472f7c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:02.275197 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cc483609-de41-46f5-b3a9-668d91472f7c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:02.275644 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cc483609-de41-46f5-b3a9-668d91472f7c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:02.276422 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cc483609-de41-46f5-b3a9-668d91472f7c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:02.276850 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cc483609-de41-46f5-b3a9-668d91472f7c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:02.333020 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f10d16eb-693d-434c-86ac-3a53619a52e8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:02.340950 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f10d16eb-693d-434c-86ac-3a53619a52e8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1557 microversion: 2.1 time: 0.171876 Aug 03 10:48:02.341750 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 276/539] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:02 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:02.362301 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-62858710-6d42-4628-8229-425b279246bc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:02.363265 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-62858710-6d42-4628-8229-425b279246bc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:02.370337 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-62858710-6d42-4628-8229-425b279246bc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:02.370787 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-62858710-6d42-4628-8229-425b279246bc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:02.371556 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-62858710-6d42-4628-8229-425b279246bc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:02.371981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-62858710-6d42-4628-8229-425b279246bc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:02.459112 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-cc483609-de41-46f5-b3a9-668d91472f7c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:02.470159 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-cc483609-de41-46f5-b3a9-668d91472f7c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1315 microversion: 2.1 time: 0.206384 Aug 03 10:48:02.470751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 264/540] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:02 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:02.480929 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-62858710-6d42-4628-8229-425b279246bc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123048 Aug 03 10:48:02.481631 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 277/541] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 3 10:48:02 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:48:02.913176 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-01bcd082-e3b4-45fa-bcdb-c668b1945f70 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:02.913981 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-01bcd082-e3b4-45fa-bcdb-c668b1945f70 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:02.920439 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-01bcd082-e3b4-45fa-bcdb-c668b1945f70 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:02.920886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-01bcd082-e3b4-45fa-bcdb-c668b1945f70 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:02.921705 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-01bcd082-e3b4-45fa-bcdb-c668b1945f70 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:02.922398 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-01bcd082-e3b4-45fa-bcdb-c668b1945f70 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:03.362462 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-01bcd082-e3b4-45fa-bcdb-c668b1945f70 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:03.392893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-01bcd082-e3b4-45fa-bcdb-c668b1945f70 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1319 microversion: 2.1 time: 0.483990 Aug 03 10:48:03.409117 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 265/542] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:02 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1319 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:03.492799 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0ab3aa99-fe50-44bc-8901-320d099ca52a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:03.494506 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0ab3aa99-fe50-44bc-8901-320d099ca52a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:03.502404 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0ab3aa99-fe50-44bc-8901-320d099ca52a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:03.506570 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0ab3aa99-fe50-44bc-8901-320d099ca52a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:03.511719 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0ab3aa99-fe50-44bc-8901-320d099ca52a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:03.513030 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0ab3aa99-fe50-44bc-8901-320d099ca52a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:03.518660 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-164081c2-a2af-46a2-beda-1adc4e985828 req-27a7672a-2384-49b4-8081-0924d8448128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98aeac07-2781-469a-a225-0757dce112d0", "name": "network-vif-plugged", "status": "completed", "tag": "778085bd-4ffa-401f-9b01-bcf86a0bb85a"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:03.539860 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-164081c2-a2af-46a2-beda-1adc4e985828 req-27a7672a-2384-49b4-8081-0924d8448128 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:03.541153 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-164081c2-a2af-46a2-beda-1adc4e985828 req-27a7672a-2384-49b4-8081-0924d8448128 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:03.563026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-164081c2-a2af-46a2-beda-1adc4e985828 req-27a7672a-2384-49b4-8081-0924d8448128 service nova] Creating event network-vif-plugged:778085bd-4ffa-401f-9b01-bcf86a0bb85a for instance 98aeac07-2781-469a-a225-0757dce112d0 on hv-cinder-85083 Aug 03 10:48:03.572093 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-164081c2-a2af-46a2-beda-1adc4e985828 req-27a7672a-2384-49b4-8081-0924d8448128 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057752 Aug 03 10:48:03.573901 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 266/543] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:03.733723 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0ab3aa99-fe50-44bc-8901-320d099ca52a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:03.743928 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0ab3aa99-fe50-44bc-8901-320d099ca52a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1315 microversion: 2.1 time: 0.257260 Aug 03 10:48:03.744660 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 278/544] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:03 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:03.904878 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-fa03ebfb-f106-4d7e-8b41-d9e0cdf4ac53 req-98c0e5f2-c9ac-4dab-aa15-3856f24e59c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "848ceec4-9b34-4e0f-a57e-95de02097455", "tag": "9cba26e5-f3cf-4c00-8b87-69db9302e407"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:03.916333 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-fa03ebfb-f106-4d7e-8b41-d9e0cdf4ac53 req-98c0e5f2-c9ac-4dab-aa15-3856f24e59c8 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:03.916836 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-fa03ebfb-f106-4d7e-8b41-d9e0cdf4ac53 req-98c0e5f2-c9ac-4dab-aa15-3856f24e59c8 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:03.929765 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-fa03ebfb-f106-4d7e-8b41-d9e0cdf4ac53 req-98c0e5f2-c9ac-4dab-aa15-3856f24e59c8 service nova] Creating event network-changed:9cba26e5-f3cf-4c00-8b87-69db9302e407 for instance 848ceec4-9b34-4e0f-a57e-95de02097455 on hv-cinder-85083 Aug 03 10:48:03.934904 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-fa03ebfb-f106-4d7e-8b41-d9e0cdf4ac53 req-98c0e5f2-c9ac-4dab-aa15-3856f24e59c8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034389 Aug 03 10:48:03.935891 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 267/545] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:03.944514 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-957d8c5a-1d7f-4f40-9c9f-416a5167de7e req-48308e8d-f021-4748-87bf-767449ad84fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4583b6a-2fb9-4b2b-acc3-02b6054f4b65", "tag": "022a56f1-f212-4e83-b4c7-7f7b6600e674"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:03.955604 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-957d8c5a-1d7f-4f40-9c9f-416a5167de7e req-48308e8d-f021-4748-87bf-767449ad84fb service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:03.956209 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-957d8c5a-1d7f-4f40-9c9f-416a5167de7e req-48308e8d-f021-4748-87bf-767449ad84fb service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:03.968603 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-957d8c5a-1d7f-4f40-9c9f-416a5167de7e req-48308e8d-f021-4748-87bf-767449ad84fb service nova] Creating event network-changed:022a56f1-f212-4e83-b4c7-7f7b6600e674 for instance c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 on hv-cinder-85083 Aug 03 10:48:03.974121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-957d8c5a-1d7f-4f40-9c9f-416a5167de7e req-48308e8d-f021-4748-87bf-767449ad84fb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034076 Aug 03 10:48:03.975369 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 279/546] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:04.416946 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-7661dae1-0d43-47bd-b6f3-30d9beb99261 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:04.417691 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-7661dae1-0d43-47bd-b6f3-30d9beb99261 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:04.423897 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7661dae1-0d43-47bd-b6f3-30d9beb99261 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:04.424342 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7661dae1-0d43-47bd-b6f3-30d9beb99261 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:04.425116 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7661dae1-0d43-47bd-b6f3-30d9beb99261 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:04.425674 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7661dae1-0d43-47bd-b6f3-30d9beb99261 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:04.569246 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7661dae1-0d43-47bd-b6f3-30d9beb99261 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:04.578188 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-7661dae1-0d43-47bd-b6f3-30d9beb99261 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1319 microversion: 2.1 time: 0.165907 Aug 03 10:48:04.579108 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 268/547] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:04 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:04.766233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a8597a68-c354-4f8e-b397-d1a1a0db8973 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:04.767632 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a8597a68-c354-4f8e-b397-d1a1a0db8973 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:04.775256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a8597a68-c354-4f8e-b397-d1a1a0db8973 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:04.775714 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a8597a68-c354-4f8e-b397-d1a1a0db8973 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:04.776516 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a8597a68-c354-4f8e-b397-d1a1a0db8973 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:04.776956 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a8597a68-c354-4f8e-b397-d1a1a0db8973 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:04.796632 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:04.949808 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a8597a68-c354-4f8e-b397-d1a1a0db8973 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:04.958321 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a8597a68-c354-4f8e-b397-d1a1a0db8973 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1315 microversion: 2.1 time: 0.195832 Aug 03 10:48:04.959935 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 280/548] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:04 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:05.600301 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4411decb-fba9-4e88-91e1-0bec95f09466 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:05.600932 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4411decb-fba9-4e88-91e1-0bec95f09466 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:05.608491 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4411decb-fba9-4e88-91e1-0bec95f09466 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:05.608962 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4411decb-fba9-4e88-91e1-0bec95f09466 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:05.609778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4411decb-fba9-4e88-91e1-0bec95f09466 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:05.610205 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4411decb-fba9-4e88-91e1-0bec95f09466 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:05.626269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=100 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:05.768788 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4411decb-fba9-4e88-91e1-0bec95f09466 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:05.778582 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-4411decb-fba9-4e88-91e1-0bec95f09466 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1319 microversion: 2.1 time: 0.182712 Aug 03 10:48:05.779285 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 269/549] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:05 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:05.980130 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a36b3c3f-b718-453d-b528-77bf4228fad8 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:05.980867 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a36b3c3f-b718-453d-b528-77bf4228fad8 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:05.987120 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a36b3c3f-b718-453d-b528-77bf4228fad8 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:05.987560 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a36b3c3f-b718-453d-b528-77bf4228fad8 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:05.988321 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a36b3c3f-b718-453d-b528-77bf4228fad8 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:05.989266 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a36b3c3f-b718-453d-b528-77bf4228fad8 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:06.119713 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d65b8023-1061-4ddb-a175-08916a1db530 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc559fe6-de81-4a57-9dc2-869907d32217"}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:06.121997 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d65b8023-1061-4ddb-a175-08916a1db530 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:06.128156 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d65b8023-1061-4ddb-a175-08916a1db530 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:06.128846 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d65b8023-1061-4ddb-a175-08916a1db530 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:06.130254 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d65b8023-1061-4ddb-a175-08916a1db530 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:06.130680 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d65b8023-1061-4ddb-a175-08916a1db530 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:06.132062 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a36b3c3f-b718-453d-b528-77bf4228fad8 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:06.140322 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a36b3c3f-b718-453d-b528-77bf4228fad8 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1464 microversion: 2.1 time: 0.163942 Aug 03 10:48:06.141182 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 281/550] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:05 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1464 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:06.187781 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c113c618-5dac-4627-9db3-d18f3819b8db tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:06.188548 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c113c618-5dac-4627-9db3-d18f3819b8db tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:06.195663 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c113c618-5dac-4627-9db3-d18f3819b8db tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:06.196191 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c113c618-5dac-4627-9db3-d18f3819b8db tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:06.197061 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c113c618-5dac-4627-9db3-d18f3819b8db tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:06.197522 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c113c618-5dac-4627-9db3-d18f3819b8db tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:06.222570 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c113c618-5dac-4627-9db3-d18f3819b8db tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:48:06.308375 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c113c618-5dac-4627-9db3-d18f3819b8db tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "DELETE /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 204 len: 0 microversion: 2.1 time: 0.124246 Aug 03 10:48:06.309021 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 282/551] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:48:06 2022] DELETE /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 10:48:06.318318 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1f1ed7ef-0729-48ce-9ef9-0aed027a9f06 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:06.319013 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1f1ed7ef-0729-48ce-9ef9-0aed027a9f06 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:06.325282 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1f1ed7ef-0729-48ce-9ef9-0aed027a9f06 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:06.325763 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1f1ed7ef-0729-48ce-9ef9-0aed027a9f06 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:06.326533 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1f1ed7ef-0729-48ce-9ef9-0aed027a9f06 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:06.326973 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1f1ed7ef-0729-48ce-9ef9-0aed027a9f06 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:06.463303 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1f1ed7ef-0729-48ce-9ef9-0aed027a9f06 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:06.470884 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1f1ed7ef-0729-48ce-9ef9-0aed027a9f06 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1470 microversion: 2.1 time: 0.157275 Aug 03 10:48:06.471448 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 283/552] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:06 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:06.800258 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c8c50b36-6467-487b-8232-609cb268df85 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:06.800859 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c8c50b36-6467-487b-8232-609cb268df85 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:06.807062 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c8c50b36-6467-487b-8232-609cb268df85 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:06.807513 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c8c50b36-6467-487b-8232-609cb268df85 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:06.808309 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c8c50b36-6467-487b-8232-609cb268df85 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:06.808742 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c8c50b36-6467-487b-8232-609cb268df85 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:06.941802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c8c50b36-6467-487b-8232-609cb268df85 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:06.949754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c8c50b36-6467-487b-8232-609cb268df85 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1319 microversion: 2.1 time: 0.153284 Aug 03 10:48:06.950347 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 284/553] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:06 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:48:07.493444 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9ade1f87-2d28-4748-b2de-202f0ff55b0a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:07.494129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9ade1f87-2d28-4748-b2de-202f0ff55b0a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:07.500270 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9ade1f87-2d28-4748-b2de-202f0ff55b0a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:07.500715 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9ade1f87-2d28-4748-b2de-202f0ff55b0a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:07.501513 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9ade1f87-2d28-4748-b2de-202f0ff55b0a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:07.501951 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9ade1f87-2d28-4748-b2de-202f0ff55b0a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:07.634721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9ade1f87-2d28-4748-b2de-202f0ff55b0a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:07.642083 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9ade1f87-2d28-4748-b2de-202f0ff55b0a tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1470 microversion: 2.1 time: 0.153280 Aug 03 10:48:07.642644 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 285/554] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:07 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:48:07.971761 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a12c3f86-49a3-4fd9-9e6b-e92121b271e5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:07.972365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a12c3f86-49a3-4fd9-9e6b-e92121b271e5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:07.979552 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a12c3f86-49a3-4fd9-9e6b-e92121b271e5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:07.979997 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a12c3f86-49a3-4fd9-9e6b-e92121b271e5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:07.980805 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a12c3f86-49a3-4fd9-9e6b-e92121b271e5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:07.981233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a12c3f86-49a3-4fd9-9e6b-e92121b271e5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:08.118645 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a12c3f86-49a3-4fd9-9e6b-e92121b271e5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:08.126388 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a12c3f86-49a3-4fd9-9e6b-e92121b271e5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1319 microversion: 2.1 time: 0.158539 Aug 03 10:48:08.127055 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 286/555] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:07 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:48:08.663480 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-844132ad-f770-42ef-852c-982cae22be8f tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:08.664120 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-844132ad-f770-42ef-852c-982cae22be8f tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:08.670217 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-844132ad-f770-42ef-852c-982cae22be8f tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:08.670792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-844132ad-f770-42ef-852c-982cae22be8f tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:08.671459 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-844132ad-f770-42ef-852c-982cae22be8f tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:08.671898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-844132ad-f770-42ef-852c-982cae22be8f tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:08.799329 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d65b8023-1061-4ddb-a175-08916a1db530 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "POST /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.683475 Aug 03 10:48:08.805345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 270/556] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 3 10:48:06 2022] POST /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-volume_attachments => generated 194 bytes in 2685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:48:08.811651 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-844132ad-f770-42ef-852c-982cae22be8f tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:08.820082 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-844132ad-f770-42ef-852c-982cae22be8f tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1470 microversion: 2.1 time: 0.160476 Aug 03 10:48:08.820665 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 287/557] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:08 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:48:09.148012 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e78758c0-97ea-4740-b707-63d7aee43f41 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:09.148922 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e78758c0-97ea-4740-b707-63d7aee43f41 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:09.156953 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e78758c0-97ea-4740-b707-63d7aee43f41 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:09.157402 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e78758c0-97ea-4740-b707-63d7aee43f41 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:09.158240 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e78758c0-97ea-4740-b707-63d7aee43f41 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:09.158677 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e78758c0-97ea-4740-b707-63d7aee43f41 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:09.331152 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e78758c0-97ea-4740-b707-63d7aee43f41 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:09.343325 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e78758c0-97ea-4740-b707-63d7aee43f41 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1319 microversion: 2.1 time: 0.199293 Aug 03 10:48:09.370716 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 271/558] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:09 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:09.792930 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-f4440a13-3e46-4128-a14d-4345461bd845 req-193252c1-eb53-41a4-b2c2-5bf859583abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98aeac07-2781-469a-a225-0757dce112d0", "name": "network-vif-deleted", "tag": "778085bd-4ffa-401f-9b01-bcf86a0bb85a"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:09.802792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-f4440a13-3e46-4128-a14d-4345461bd845 req-193252c1-eb53-41a4-b2c2-5bf859583abb service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:09.803242 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-f4440a13-3e46-4128-a14d-4345461bd845 req-193252c1-eb53-41a4-b2c2-5bf859583abb service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:09.816309 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-f4440a13-3e46-4128-a14d-4345461bd845 req-193252c1-eb53-41a4-b2c2-5bf859583abb service nova] Creating event network-vif-deleted:778085bd-4ffa-401f-9b01-bcf86a0bb85a for instance 98aeac07-2781-469a-a225-0757dce112d0 on hv-cinder-85083 Aug 03 10:48:09.822475 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-f4440a13-3e46-4128-a14d-4345461bd845 req-193252c1-eb53-41a4-b2c2-5bf859583abb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033104 Aug 03 10:48:09.822951 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 288/559] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:09.845749 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9e2491f0-e3db-432f-9f73-449d8a8a5bf9 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:09.846649 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9e2491f0-e3db-432f-9f73-449d8a8a5bf9 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:09.858177 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9e2491f0-e3db-432f-9f73-449d8a8a5bf9 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:09.858621 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9e2491f0-e3db-432f-9f73-449d8a8a5bf9 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:09.859508 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9e2491f0-e3db-432f-9f73-449d8a8a5bf9 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:09.859937 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9e2491f0-e3db-432f-9f73-449d8a8a5bf9 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:09.954969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9e2491f0-e3db-432f-9f73-449d8a8a5bf9 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b889e606f453e8fd5bc0710072fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ec0038f90e431dbe8ac58bf109e259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:09.965552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9e2491f0-e3db-432f-9f73-449d8a8a5bf9 tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 200 len: 1300 microversion: 2.1 time: 0.126515 Aug 03 10:48:09.966777 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 272/560] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:09 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 1300 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:10.388989 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4998cf05-98c5-4e67-9cdf-87e962800b6f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:10.389739 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4998cf05-98c5-4e67-9cdf-87e962800b6f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:10.396780 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4998cf05-98c5-4e67-9cdf-87e962800b6f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:10.397246 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4998cf05-98c5-4e67-9cdf-87e962800b6f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:10.398158 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4998cf05-98c5-4e67-9cdf-87e962800b6f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:10.398596 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4998cf05-98c5-4e67-9cdf-87e962800b6f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:10.535815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4998cf05-98c5-4e67-9cdf-87e962800b6f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:10.543567 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4998cf05-98c5-4e67-9cdf-87e962800b6f tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1319 microversion: 2.1 time: 0.167109 Aug 03 10:48:10.544078 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 289/561] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:10 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:10.987325 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2c05408f-4ebb-44a6-bcdc-8b8801ea6c9c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:10.987926 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2c05408f-4ebb-44a6-bcdc-8b8801ea6c9c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] [instance: 98aeac07-2781-469a-a225-0757dce112d0] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:10.990952 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:10.991908 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=6 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:10.998956 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2c05408f-4ebb-44a6-bcdc-8b8801ea6c9c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:10.999401 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2c05408f-4ebb-44a6-bcdc-8b8801ea6c9c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:11.000168 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2c05408f-4ebb-44a6-bcdc-8b8801ea6c9c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:11.000620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2c05408f-4ebb-44a6-bcdc-8b8801ea6c9c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:11.016710 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-2c05408f-4ebb-44a6-bcdc-8b8801ea6c9c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] HTTP exception thrown: Instance 98aeac07-2781-469a-a225-0757dce112d0 could not be found. Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2c05408f-4ebb-44a6-bcdc-8b8801ea6c9c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Request method failure captured: Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 HTTP/1.1 Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lJTSBBC_vRmk4YF2XPvsrmSFkEyZJe49L3bapXsEJSmgcuJVLdeGghn2tFtEs34rSws7V20FP8c-GJWBdsyd8lb3QSoQB-wAaIbvA7sbu4IB5DRZpWWM_gLdiloGUNccA6LHGIOEhvOs4NpopGsmlTpL3EWXSZ2eH3v6avDDxRaRN4 Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: 79ec0038f90e431dbe8ac58bf109e259 Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-VolumesNegativeTest-20185049 Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:48:11.018381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:48:11.021551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/79ec0038f90e431dbe8ac58bf109e259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/79ec0038f90e431dbe8ac58bf109e259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/79ec0038f90e431dbe8ac58bf109e259"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_79ec0038f90e431dbe8ac58bf109e259", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:48:11.021551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-VolumesNegativeTest-20185049 Aug 03 10:48:11.021551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: 79ec0038f90e431dbe8ac58bf109e259 Aug 03 10:48:11.021551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-VolumesNegativeTest-20185049 Aug 03 10:48:11.021551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-VolumesNegativeTest-20185049-project Aug 03 10:48:11.021551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:48:11.021551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:48:11.021551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: ea2b889e606f453e8fd5bc0710072fa6 Aug 03 10:48:11.021551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-VolumesNegativeTest-20185049-project Aug 03 10:48:11.021551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:48:11.021551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 98aeac07-2781-469a-a225-0757dce112d0 could not be found. Aug 03 10:48:11.021551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '98aeac07-2781-469a-a225-0757dce112d0'} Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98aeac07-2781-469a-a225-0757dce112d0 could not be found. Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:48:11.023174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98aeac07-2781-469a-a225-0757dce112d0 could not be found. Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98aeac07-2781-469a-a225-0757dce112d0 could not be found. Aug 03 10:48:11.025886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:48:11.028391 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2c05408f-4ebb-44a6-bcdc-8b8801ea6c9c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] Returning 404 to user: Instance 98aeac07-2781-469a-a225-0757dce112d0 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:48:11.028391 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2c05408f-4ebb-44a6-bcdc-8b8801ea6c9c tempest-VolumesNegativeTest-20185049 tempest-VolumesNegativeTest-20185049-project] 10.222.0.47 "GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0" status: 404 len: 111 microversion: 2.1 time: 0.036613 Aug 03 10:48:11.028391 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 273/562] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:10 2022] GET /compute/v2.1/servers/98aeac07-2781-469a-a225-0757dce112d0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:48:11.526755 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-eaf12d23-7a1a-4a8a-be59-9ab3a6ab9948 req-b06c9f53-77bf-4ee4-8ac4-bbf4eac97f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4583b6a-2fb9-4b2b-acc3-02b6054f4b65", "name": "network-vif-plugged", "status": "completed", "tag": "022a56f1-f212-4e83-b4c7-7f7b6600e674"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:11.533908 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:11.543655 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-eaf12d23-7a1a-4a8a-be59-9ab3a6ab9948 req-b06c9f53-77bf-4ee4-8ac4-bbf4eac97f90 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:11.544668 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-eaf12d23-7a1a-4a8a-be59-9ab3a6ab9948 req-b06c9f53-77bf-4ee4-8ac4-bbf4eac97f90 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:11.557518 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-eaf12d23-7a1a-4a8a-be59-9ab3a6ab9948 req-b06c9f53-77bf-4ee4-8ac4-bbf4eac97f90 service nova] Creating event network-vif-plugged:022a56f1-f212-4e83-b4c7-7f7b6600e674 for instance c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 on hv-cinder-85083 Aug 03 10:48:11.563386 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-eaf12d23-7a1a-4a8a-be59-9ab3a6ab9948 req-b06c9f53-77bf-4ee4-8ac4-bbf4eac97f90 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041663 Aug 03 10:48:11.564004 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 290/563] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:11.567106 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-00c164fd-abc6-4a3d-8e5d-02d97ef1f374 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:11.568464 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-00c164fd-abc6-4a3d-8e5d-02d97ef1f374 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:11.576311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-00c164fd-abc6-4a3d-8e5d-02d97ef1f374 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:11.579847 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-00c164fd-abc6-4a3d-8e5d-02d97ef1f374 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:11.585983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-00c164fd-abc6-4a3d-8e5d-02d97ef1f374 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:11.586455 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-00c164fd-abc6-4a3d-8e5d-02d97ef1f374 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:11.752944 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-00c164fd-abc6-4a3d-8e5d-02d97ef1f374 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:11.762072 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-00c164fd-abc6-4a3d-8e5d-02d97ef1f374 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1319 microversion: 2.1 time: 0.200992 Aug 03 10:48:11.762793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 274/564] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:11 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:12.784661 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-acc85303-0c23-416a-846c-67bde439e329 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:12.785362 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-acc85303-0c23-416a-846c-67bde439e329 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:12.792667 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-acc85303-0c23-416a-846c-67bde439e329 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:12.793123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-acc85303-0c23-416a-846c-67bde439e329 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:12.793941 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-acc85303-0c23-416a-846c-67bde439e329 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:12.794383 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-acc85303-0c23-416a-846c-67bde439e329 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:13.019181 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-acc85303-0c23-416a-846c-67bde439e329 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:13.033727 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-acc85303-0c23-416a-846c-67bde439e329 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1319 microversion: 2.1 time: 0.252883 Aug 03 10:48:13.034913 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 291/565] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:12 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:14.058912 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-8eec2cef-9930-438f-9e98-750efc3dfbe1 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:14.059526 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-8eec2cef-9930-438f-9e98-750efc3dfbe1 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:14.066865 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8eec2cef-9930-438f-9e98-750efc3dfbe1 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:14.068066 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8eec2cef-9930-438f-9e98-750efc3dfbe1 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:14.068888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8eec2cef-9930-438f-9e98-750efc3dfbe1 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:14.069325 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8eec2cef-9930-438f-9e98-750efc3dfbe1 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:14.229016 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-8eec2cef-9930-438f-9e98-750efc3dfbe1 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:14.240280 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-8eec2cef-9930-438f-9e98-750efc3dfbe1 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1509 microversion: 2.1 time: 0.184630 Aug 03 10:48:14.241162 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 275/566] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:14 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:48:14.265225 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ac72dcb4-6f87-4c7f-aa98-aa69bf719623 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87b38add-a583-4b2c-8c3a-58207dde4199", "device": "/dev/sdb"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:14.268238 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ac72dcb4-6f87-4c7f-aa98-aa69bf719623 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:14.274841 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ac72dcb4-6f87-4c7f-aa98-aa69bf719623 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:14.275657 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ac72dcb4-6f87-4c7f-aa98-aa69bf719623 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:14.275938 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ac72dcb4-6f87-4c7f-aa98-aa69bf719623 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:14.276364 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ac72dcb4-6f87-4c7f-aa98-aa69bf719623 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:14.649633 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ac72dcb4-6f87-4c7f-aa98-aa69bf719623 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "POST /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.388317 Aug 03 10:48:14.650462 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 292/567] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 3 10:48:14 2022] POST /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:16.396912 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-503c88c1-20d7-4a12-be6d-0ea18419198b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:16.399298 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-503c88c1-20d7-4a12-be6d-0ea18419198b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:16.406201 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-503c88c1-20d7-4a12-be6d-0ea18419198b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:16.406683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-503c88c1-20d7-4a12-be6d-0ea18419198b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:16.407793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-503c88c1-20d7-4a12-be6d-0ea18419198b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:16.408234 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-503c88c1-20d7-4a12-be6d-0ea18419198b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:16.432378 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-503c88c1-20d7-4a12-be6d-0ea18419198b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lazy-loading 'flavor' on Instance uuid 00b0240d-3638-48b2-a7f3-2269dd2aba05 {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:48:16.561680 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-503c88c1-20d7-4a12-be6d-0ea18419198b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "POST /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/action" status: 200 len: 32 microversion: 2.1 time: 0.168702 Aug 03 10:48:16.562300 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 276/568] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 3 10:48:16 2022] POST /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 10:48:16.575841 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8808b7d6-8d40-47f6-b09a-3e3da3c3d95f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:16.576774 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8808b7d6-8d40-47f6-b09a-3e3da3c3d95f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:16.585139 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8808b7d6-8d40-47f6-b09a-3e3da3c3d95f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:16.585759 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8808b7d6-8d40-47f6-b09a-3e3da3c3d95f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:16.586643 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8808b7d6-8d40-47f6-b09a-3e3da3c3d95f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:16.587155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8808b7d6-8d40-47f6-b09a-3e3da3c3d95f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:16.745453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8808b7d6-8d40-47f6-b09a-3e3da3c3d95f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:16.753741 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8808b7d6-8d40-47f6-b09a-3e3da3c3d95f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.182716 Aug 03 10:48:16.754314 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 293/569] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:16 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:17.777093 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1e5a2eae-9fee-44a3-9d70-f24647cc1587 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:17.777870 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-1e5a2eae-9fee-44a3-9d70-f24647cc1587 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:17.784734 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1e5a2eae-9fee-44a3-9d70-f24647cc1587 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:17.785196 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1e5a2eae-9fee-44a3-9d70-f24647cc1587 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:17.786118 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1e5a2eae-9fee-44a3-9d70-f24647cc1587 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:17.787083 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1e5a2eae-9fee-44a3-9d70-f24647cc1587 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:17.927743 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1e5a2eae-9fee-44a3-9d70-f24647cc1587 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:17.936250 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1e5a2eae-9fee-44a3-9d70-f24647cc1587 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.163679 Aug 03 10:48:17.936760 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 277/570] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:17 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:18.188156 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-83687287-2ab3-4b66-927c-cf4432d11021 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:18.188881 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-83687287-2ab3-4b66-927c-cf4432d11021 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:18.195777 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-83687287-2ab3-4b66-927c-cf4432d11021 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:18.196231 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-83687287-2ab3-4b66-927c-cf4432d11021 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:18.197011 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-83687287-2ab3-4b66-927c-cf4432d11021 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:18.197447 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-83687287-2ab3-4b66-927c-cf4432d11021 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:18.229292 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-83687287-2ab3-4b66-927c-cf4432d11021 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments/f9981807-3df5-431b-80c5-0e3ce67245d6" status: 200 len: 194 microversion: 2.20 time: 0.045269 Aug 03 10:48:18.229968 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 294/571] 10.222.0.47 () {60 vars in 1454 bytes} [Wed Aug 3 10:48:18 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments/f9981807-3df5-431b-80c5-0e3ce67245d6 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:48:18.303917 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-74af2dd5-90a3-4627-a65c-05e2a5e8b79d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:18.304467 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-74af2dd5-90a3-4627-a65c-05e2a5e8b79d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:18.311219 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-74af2dd5-90a3-4627-a65c-05e2a5e8b79d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:18.311632 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-74af2dd5-90a3-4627-a65c-05e2a5e8b79d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:18.312550 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-74af2dd5-90a3-4627-a65c-05e2a5e8b79d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:18.312966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-74af2dd5-90a3-4627-a65c-05e2a5e8b79d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:18.398792 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-74af2dd5-90a3-4627-a65c-05e2a5e8b79d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lazy-loading 'services' on Instance uuid 5895a291-434d-4b7c-85cd-0264cf37f5f3 {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:48:18.480166 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-74af2dd5-90a3-4627-a65c-05e2a5e8b79d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments/f9981807-3df5-431b-80c5-0e3ce67245d6" status: 202 len: 0 microversion: 2.20 time: 0.180746 Aug 03 10:48:18.480843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 278/572] 10.222.0.47 () {60 vars in 1457 bytes} [Wed Aug 3 10:48:18 2022] DELETE /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments/f9981807-3df5-431b-80c5-0e3ce67245d6 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:48:18.490413 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8b47f8d5-379f-49e4-b923-3f2a101e7edf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:18.492862 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8b47f8d5-379f-49e4-b923-3f2a101e7edf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:18.500786 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b47f8d5-379f-49e4-b923-3f2a101e7edf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:18.501349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b47f8d5-379f-49e4-b923-3f2a101e7edf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:18.502307 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b47f8d5-379f-49e4-b923-3f2a101e7edf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:18.503778 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b47f8d5-379f-49e4-b923-3f2a101e7edf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:18.520964 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:18.541521 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8b47f8d5-379f-49e4-b923-3f2a101e7edf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055966 Aug 03 10:48:18.542108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 295/573] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 3 10:48:18 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:48:18.959546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-09054602-c435-4862-ba2d-0ddffabb9888 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:18.960294 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-09054602-c435-4862-ba2d-0ddffabb9888 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:18.966533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-09054602-c435-4862-ba2d-0ddffabb9888 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:18.966991 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-09054602-c435-4862-ba2d-0ddffabb9888 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:18.968026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-09054602-c435-4862-ba2d-0ddffabb9888 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:18.968468 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-09054602-c435-4862-ba2d-0ddffabb9888 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:19.106144 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-09054602-c435-4862-ba2d-0ddffabb9888 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:19.114964 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-09054602-c435-4862-ba2d-0ddffabb9888 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.160325 Aug 03 10:48:19.115528 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 279/574] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:18 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:19.555572 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-478d47f2-3838-4039-9871-2d45ab38a853 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:19.557773 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-478d47f2-3838-4039-9871-2d45ab38a853 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:19.560090 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:19.565365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-478d47f2-3838-4039-9871-2d45ab38a853 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:19.565841 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-478d47f2-3838-4039-9871-2d45ab38a853 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:19.566606 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-478d47f2-3838-4039-9871-2d45ab38a853 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:19.567045 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-478d47f2-3838-4039-9871-2d45ab38a853 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:19.595646 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-478d47f2-3838-4039-9871-2d45ab38a853 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044651 Aug 03 10:48:19.596205 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 296/575] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 3 10:48:19 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:48:20.136609 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b90b2431-d62e-45e3-a3af-fbcff6c4c09f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:20.137253 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b90b2431-d62e-45e3-a3af-fbcff6c4c09f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:20.144026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b90b2431-d62e-45e3-a3af-fbcff6c4c09f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:20.144482 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b90b2431-d62e-45e3-a3af-fbcff6c4c09f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:20.145263 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b90b2431-d62e-45e3-a3af-fbcff6c4c09f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:20.146262 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b90b2431-d62e-45e3-a3af-fbcff6c4c09f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:20.283702 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b90b2431-d62e-45e3-a3af-fbcff6c4c09f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:20.292451 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b90b2431-d62e-45e3-a3af-fbcff6c4c09f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.159726 Aug 03 10:48:20.293041 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 280/576] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:20 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:20.608503 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fe10dabc-8145-46c5-8674-4f7a95508223 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:20.610562 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fe10dabc-8145-46c5-8674-4f7a95508223 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:20.618058 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fe10dabc-8145-46c5-8674-4f7a95508223 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:20.618501 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fe10dabc-8145-46c5-8674-4f7a95508223 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:20.619282 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fe10dabc-8145-46c5-8674-4f7a95508223 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:20.619806 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fe10dabc-8145-46c5-8674-4f7a95508223 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:20.653972 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fe10dabc-8145-46c5-8674-4f7a95508223 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049391 Aug 03 10:48:20.654545 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 297/577] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 3 10:48:20 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:48:21.315694 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3dd1011f-7566-4ba2-88b2-27d508b6388e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:21.316244 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3dd1011f-7566-4ba2-88b2-27d508b6388e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:21.323549 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3dd1011f-7566-4ba2-88b2-27d508b6388e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:21.323996 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3dd1011f-7566-4ba2-88b2-27d508b6388e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:21.324766 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3dd1011f-7566-4ba2-88b2-27d508b6388e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:21.325191 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3dd1011f-7566-4ba2-88b2-27d508b6388e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:21.473236 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3dd1011f-7566-4ba2-88b2-27d508b6388e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:21.481998 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3dd1011f-7566-4ba2-88b2-27d508b6388e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.170824 Aug 03 10:48:21.482573 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 281/578] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:21 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:21.666366 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c9606310-80bc-454a-a6c4-352131cdc7f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:21.668407 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c9606310-80bc-454a-a6c4-352131cdc7f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:21.674930 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c9606310-80bc-454a-a6c4-352131cdc7f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:21.675373 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c9606310-80bc-454a-a6c4-352131cdc7f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:21.676128 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c9606310-80bc-454a-a6c4-352131cdc7f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:21.677153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c9606310-80bc-454a-a6c4-352131cdc7f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:21.707110 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c9606310-80bc-454a-a6c4-352131cdc7f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044696 Aug 03 10:48:21.707922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 298/579] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 3 10:48:21 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:48:22.503556 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-24e064ad-82cd-49c4-afa3-88cbc954fc33 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:22.504215 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-24e064ad-82cd-49c4-afa3-88cbc954fc33 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:22.512765 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-24e064ad-82cd-49c4-afa3-88cbc954fc33 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:22.513401 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-24e064ad-82cd-49c4-afa3-88cbc954fc33 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:22.514289 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-24e064ad-82cd-49c4-afa3-88cbc954fc33 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:22.514866 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-24e064ad-82cd-49c4-afa3-88cbc954fc33 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:22.671269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-24e064ad-82cd-49c4-afa3-88cbc954fc33 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:22.673818 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:22.682687 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-24e064ad-82cd-49c4-afa3-88cbc954fc33 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.182995 Aug 03 10:48:22.683250 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 282/580] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:22 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:22.725158 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b912b197-7ed8-48a8-bf75-a4e64163a74c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:22.728972 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b912b197-7ed8-48a8-bf75-a4e64163a74c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:22.741223 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b912b197-7ed8-48a8-bf75-a4e64163a74c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:22.741762 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b912b197-7ed8-48a8-bf75-a4e64163a74c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:22.742721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b912b197-7ed8-48a8-bf75-a4e64163a74c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:22.743431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b912b197-7ed8-48a8-bf75-a4e64163a74c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:22.779541 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b912b197-7ed8-48a8-bf75-a4e64163a74c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063005 Aug 03 10:48:22.780126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 299/581] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 3 10:48:22 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:48:23.716439 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a890222e-8f35-41a6-ba3a-14d2a7d418c7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:23.717043 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-a890222e-8f35-41a6-ba3a-14d2a7d418c7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:23.724593 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a890222e-8f35-41a6-ba3a-14d2a7d418c7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:23.725720 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a890222e-8f35-41a6-ba3a-14d2a7d418c7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:23.726473 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a890222e-8f35-41a6-ba3a-14d2a7d418c7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:23.726902 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a890222e-8f35-41a6-ba3a-14d2a7d418c7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:23.796858 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0e2c20d5-8eed-4cb7-a983-53a1234784b4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:23.800723 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0e2c20d5-8eed-4cb7-a983-53a1234784b4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:23.809036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0e2c20d5-8eed-4cb7-a983-53a1234784b4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:23.809529 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0e2c20d5-8eed-4cb7-a983-53a1234784b4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:23.810333 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0e2c20d5-8eed-4cb7-a983-53a1234784b4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:23.810805 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0e2c20d5-8eed-4cb7-a983-53a1234784b4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:23.843189 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0e2c20d5-8eed-4cb7-a983-53a1234784b4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053948 Aug 03 10:48:23.843777 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 300/582] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 3 10:48:23 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:23.877091 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-a890222e-8f35-41a6-ba3a-14d2a7d418c7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:23.888577 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-a890222e-8f35-41a6-ba3a-14d2a7d418c7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.175477 Aug 03 10:48:23.889800 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 283/583] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:23 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:23.908727 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9de33588-5c25-4835-b010-be9bb4f05b40 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:23.909248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9de33588-5c25-4835-b010-be9bb4f05b40 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:23.920356 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9de33588-5c25-4835-b010-be9bb4f05b40 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:23.920800 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9de33588-5c25-4835-b010-be9bb4f05b40 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:23.921613 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9de33588-5c25-4835-b010-be9bb4f05b40 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:23.922045 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9de33588-5c25-4835-b010-be9bb4f05b40 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:23.949145 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9de33588-5c25-4835-b010-be9bb4f05b40 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:48:24.032598 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9de33588-5c25-4835-b010-be9bb4f05b40 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 204 len: 0 microversion: 2.20 time: 0.127434 Aug 03 10:48:24.033680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 301/584] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Aug 3 10:48:23 2022] DELETE /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 10:48:24.042378 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1d9f898a-e84d-4d4d-93df-28819895153e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:24.043077 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-1d9f898a-e84d-4d4d-93df-28819895153e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:24.053138 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1d9f898a-e84d-4d4d-93df-28819895153e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:24.054442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1d9f898a-e84d-4d4d-93df-28819895153e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:24.055245 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1d9f898a-e84d-4d4d-93df-28819895153e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:24.055680 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1d9f898a-e84d-4d4d-93df-28819895153e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:24.196314 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1d9f898a-e84d-4d4d-93df-28819895153e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:24.204473 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1d9f898a-e84d-4d4d-93df-28819895153e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:24.205995 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1d9f898a-e84d-4d4d-93df-28819895153e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:24.207165 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1d9f898a-e84d-4d4d-93df-28819895153e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.169250 Aug 03 10:48:24.207722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 284/585] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:24 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:24.911831 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9aa6e618-455c-4426-9d41-a8bf5c46942c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:24.913036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9aa6e618-455c-4426-9d41-a8bf5c46942c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:24.919819 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9aa6e618-455c-4426-9d41-a8bf5c46942c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:24.920262 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9aa6e618-455c-4426-9d41-a8bf5c46942c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:24.921016 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9aa6e618-455c-4426-9d41-a8bf5c46942c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:24.921443 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9aa6e618-455c-4426-9d41-a8bf5c46942c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:25.064829 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9aa6e618-455c-4426-9d41-a8bf5c46942c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:25.073117 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9aa6e618-455c-4426-9d41-a8bf5c46942c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.165555 Aug 03 10:48:25.073738 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 302/586] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:24 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:25.231227 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c5fe8789-3bc2-4f4d-941e-42196231d4a6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:25.231974 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-c5fe8789-3bc2-4f4d-941e-42196231d4a6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:25.239133 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c5fe8789-3bc2-4f4d-941e-42196231d4a6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:25.239573 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c5fe8789-3bc2-4f4d-941e-42196231d4a6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:25.240344 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c5fe8789-3bc2-4f4d-941e-42196231d4a6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:25.240885 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c5fe8789-3bc2-4f4d-941e-42196231d4a6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:25.392282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c5fe8789-3bc2-4f4d-941e-42196231d4a6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:25.402439 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c5fe8789-3bc2-4f4d-941e-42196231d4a6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:25.403993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c5fe8789-3bc2-4f4d-941e-42196231d4a6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:25.405604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c5fe8789-3bc2-4f4d-941e-42196231d4a6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.178252 Aug 03 10:48:25.406434 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 285/587] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:25 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:26.095141 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cc7e2fb6-2d73-4549-93a0-8592a6a028e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:26.095777 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-cc7e2fb6-2d73-4549-93a0-8592a6a028e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:26.102392 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc7e2fb6-2d73-4549-93a0-8592a6a028e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:26.102833 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc7e2fb6-2d73-4549-93a0-8592a6a028e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:26.103608 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc7e2fb6-2d73-4549-93a0-8592a6a028e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:26.104025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc7e2fb6-2d73-4549-93a0-8592a6a028e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:26.230622 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-cc7e2fb6-2d73-4549-93a0-8592a6a028e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:26.239077 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-cc7e2fb6-2d73-4549-93a0-8592a6a028e3 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.147747 Aug 03 10:48:26.239647 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 303/588] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:26 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:26.428936 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2fc20fcb-cd54-4365-80f7-c779eea3f47f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:26.429694 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2fc20fcb-cd54-4365-80f7-c779eea3f47f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:26.436190 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fc20fcb-cd54-4365-80f7-c779eea3f47f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:26.436634 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fc20fcb-cd54-4365-80f7-c779eea3f47f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:26.437411 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fc20fcb-cd54-4365-80f7-c779eea3f47f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:26.437892 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fc20fcb-cd54-4365-80f7-c779eea3f47f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:26.579042 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2fc20fcb-cd54-4365-80f7-c779eea3f47f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:26.588010 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2fc20fcb-cd54-4365-80f7-c779eea3f47f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:26.589537 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2fc20fcb-cd54-4365-80f7-c779eea3f47f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:26.590714 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2fc20fcb-cd54-4365-80f7-c779eea3f47f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.166457 Aug 03 10:48:26.591338 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 286/589] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:26 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:27.261098 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-31b36e0d-8bfb-4f49-be55-106648a42799 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:27.261768 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-31b36e0d-8bfb-4f49-be55-106648a42799 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:27.268196 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-31b36e0d-8bfb-4f49-be55-106648a42799 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:27.268643 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-31b36e0d-8bfb-4f49-be55-106648a42799 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:27.269419 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-31b36e0d-8bfb-4f49-be55-106648a42799 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:27.269869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-31b36e0d-8bfb-4f49-be55-106648a42799 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:27.398047 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-31b36e0d-8bfb-4f49-be55-106648a42799 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:27.406118 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-31b36e0d-8bfb-4f49-be55-106648a42799 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.148852 Aug 03 10:48:27.406743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 304/590] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:27 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:27.617601 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-fcc93847-a47d-4f78-8e62-b4cb52f81c50 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:27.618598 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-fcc93847-a47d-4f78-8e62-b4cb52f81c50 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:27.629393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fcc93847-a47d-4f78-8e62-b4cb52f81c50 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:27.630138 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fcc93847-a47d-4f78-8e62-b4cb52f81c50 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:27.632012 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fcc93847-a47d-4f78-8e62-b4cb52f81c50 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:27.632734 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fcc93847-a47d-4f78-8e62-b4cb52f81c50 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:27.803054 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fcc93847-a47d-4f78-8e62-b4cb52f81c50 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:27.823039 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fcc93847-a47d-4f78-8e62-b4cb52f81c50 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:27.824548 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fcc93847-a47d-4f78-8e62-b4cb52f81c50 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:27.825743 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-fcc93847-a47d-4f78-8e62-b4cb52f81c50 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.215757 Aug 03 10:48:27.826139 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9867acff-277e-40bb-ba47-fafebf294835 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:27.826292 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 287/591] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:27 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:48:27.828700 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9867acff-277e-40bb-ba47-fafebf294835 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:27.834822 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9867acff-277e-40bb-ba47-fafebf294835 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:27.835347 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9867acff-277e-40bb-ba47-fafebf294835 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:27.836186 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9867acff-277e-40bb-ba47-fafebf294835 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:27.836692 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9867acff-277e-40bb-ba47-fafebf294835 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:27.865427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9867acff-277e-40bb-ba47-fafebf294835 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043426 Aug 03 10:48:27.866698 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 305/592] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:48:27 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 10:48:27.926938 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-319a6f99-0853-4707-9d54-1b2f32482540 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:27.927363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-319a6f99-0853-4707-9d54-1b2f32482540 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:27.934093 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-319a6f99-0853-4707-9d54-1b2f32482540 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:27.934534 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-319a6f99-0853-4707-9d54-1b2f32482540 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:27.935280 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-319a6f99-0853-4707-9d54-1b2f32482540 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:27.935707 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-319a6f99-0853-4707-9d54-1b2f32482540 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:27.964718 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-319a6f99-0853-4707-9d54-1b2f32482540 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Going to try to terminate instance {{(pid=124389) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:48:28.038910 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-319a6f99-0853-4707-9d54-1b2f32482540 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 204 len: 0 microversion: 2.1 time: 0.115556 Aug 03 10:48:28.039484 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 288/593] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:48:27 2022] DELETE /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:48:28.047839 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b81a0e2f-b0c5-422a-be5a-45d3468bc628 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:28.048439 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b81a0e2f-b0c5-422a-be5a-45d3468bc628 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:28.055181 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b81a0e2f-b0c5-422a-be5a-45d3468bc628 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:28.055621 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b81a0e2f-b0c5-422a-be5a-45d3468bc628 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:28.056374 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b81a0e2f-b0c5-422a-be5a-45d3468bc628 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:28.056798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b81a0e2f-b0c5-422a-be5a-45d3468bc628 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:28.190354 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b81a0e2f-b0c5-422a-be5a-45d3468bc628 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:28.197967 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b81a0e2f-b0c5-422a-be5a-45d3468bc628 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1674 microversion: 2.1 time: 0.154083 Aug 03 10:48:28.198528 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 306/594] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:28 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:48:28.427601 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-753f3d38-9911-4074-83db-390242c14292 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:28.428302 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-753f3d38-9911-4074-83db-390242c14292 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:28.434392 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-753f3d38-9911-4074-83db-390242c14292 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:28.434836 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-753f3d38-9911-4074-83db-390242c14292 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:28.435598 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-753f3d38-9911-4074-83db-390242c14292 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:28.436033 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-753f3d38-9911-4074-83db-390242c14292 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:28.569566 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-753f3d38-9911-4074-83db-390242c14292 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:28.577644 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-753f3d38-9911-4074-83db-390242c14292 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.154196 Aug 03 10:48:28.578221 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 289/595] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:28 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:28.849374 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-33ce86ac-3313-4ded-aac4-adf072323b1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:28.850060 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-33ce86ac-3313-4ded-aac4-adf072323b1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:28.857200 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-33ce86ac-3313-4ded-aac4-adf072323b1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:28.857690 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-33ce86ac-3313-4ded-aac4-adf072323b1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:28.858472 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-33ce86ac-3313-4ded-aac4-adf072323b1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:28.858910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-33ce86ac-3313-4ded-aac4-adf072323b1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:29.001564 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-33ce86ac-3313-4ded-aac4-adf072323b1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:29.010396 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-33ce86ac-3313-4ded-aac4-adf072323b1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:29.011943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-33ce86ac-3313-4ded-aac4-adf072323b1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:29.013106 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-33ce86ac-3313-4ded-aac4-adf072323b1a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.167966 Aug 03 10:48:29.013692 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 307/596] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:28 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:29.220293 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-92245995-f8ce-4757-9447-988e9065d412 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:29.220889 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-92245995-f8ce-4757-9447-988e9065d412 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:29.227986 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-92245995-f8ce-4757-9447-988e9065d412 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:29.228424 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-92245995-f8ce-4757-9447-988e9065d412 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:29.229193 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-92245995-f8ce-4757-9447-988e9065d412 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:29.229650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-92245995-f8ce-4757-9447-988e9065d412 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:29.361167 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-92245995-f8ce-4757-9447-988e9065d412 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:29.369597 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-92245995-f8ce-4757-9447-988e9065d412 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1674 microversion: 2.1 time: 0.153111 Aug 03 10:48:29.370159 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 290/597] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:29 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:29.599732 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5984ba58-eae7-4e2f-a447-9fd13cefd65c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:29.600245 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5984ba58-eae7-4e2f-a447-9fd13cefd65c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:29.606347 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5984ba58-eae7-4e2f-a447-9fd13cefd65c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:29.606790 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5984ba58-eae7-4e2f-a447-9fd13cefd65c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:29.607542 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5984ba58-eae7-4e2f-a447-9fd13cefd65c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:29.607990 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5984ba58-eae7-4e2f-a447-9fd13cefd65c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:29.741158 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5984ba58-eae7-4e2f-a447-9fd13cefd65c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:29.749284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5984ba58-eae7-4e2f-a447-9fd13cefd65c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.153452 Aug 03 10:48:29.749876 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 308/598] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:29 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:30.036311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d6113704-5149-494c-87d2-bbadf8b454f3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:30.036905 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d6113704-5149-494c-87d2-bbadf8b454f3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:30.043945 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d6113704-5149-494c-87d2-bbadf8b454f3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:30.044383 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d6113704-5149-494c-87d2-bbadf8b454f3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:30.045135 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d6113704-5149-494c-87d2-bbadf8b454f3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:30.045601 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d6113704-5149-494c-87d2-bbadf8b454f3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:30.182150 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d6113704-5149-494c-87d2-bbadf8b454f3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:30.190848 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d6113704-5149-494c-87d2-bbadf8b454f3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:30.194499 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d6113704-5149-494c-87d2-bbadf8b454f3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:30.195690 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d6113704-5149-494c-87d2-bbadf8b454f3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.163396 Aug 03 10:48:30.196254 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 291/599] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:30 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:30.390559 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2fc84c65-ba21-46c7-9b0a-4423dddde575 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:30.391818 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2fc84c65-ba21-46c7-9b0a-4423dddde575 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:30.399925 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2fc84c65-ba21-46c7-9b0a-4423dddde575 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:30.400378 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2fc84c65-ba21-46c7-9b0a-4423dddde575 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:30.401158 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2fc84c65-ba21-46c7-9b0a-4423dddde575 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:30.405859 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2fc84c65-ba21-46c7-9b0a-4423dddde575 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:30.540840 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2fc84c65-ba21-46c7-9b0a-4423dddde575 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:30.548313 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2fc84c65-ba21-46c7-9b0a-4423dddde575 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1674 microversion: 2.1 time: 0.161677 Aug 03 10:48:30.548877 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 309/600] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:30 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:30.771126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5f3a428f-b55f-458f-b5a4-0facd71fadb0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:30.772142 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-5f3a428f-b55f-458f-b5a4-0facd71fadb0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:30.774722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:30.780433 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5f3a428f-b55f-458f-b5a4-0facd71fadb0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:30.780965 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5f3a428f-b55f-458f-b5a4-0facd71fadb0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:30.781680 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5f3a428f-b55f-458f-b5a4-0facd71fadb0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:30.782111 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5f3a428f-b55f-458f-b5a4-0facd71fadb0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:30.914986 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5f3a428f-b55f-458f-b5a4-0facd71fadb0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:30.923562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5f3a428f-b55f-458f-b5a4-0facd71fadb0 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.156251 Aug 03 10:48:30.924165 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 292/601] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:30 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:31.220785 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d0815623-d4ec-433b-bbc2-cefc4da2956b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:31.221400 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d0815623-d4ec-433b-bbc2-cefc4da2956b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:31.228385 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d0815623-d4ec-433b-bbc2-cefc4da2956b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:31.228837 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d0815623-d4ec-433b-bbc2-cefc4da2956b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:31.229695 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d0815623-d4ec-433b-bbc2-cefc4da2956b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:31.230137 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d0815623-d4ec-433b-bbc2-cefc4da2956b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:31.246790 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:31.364627 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d0815623-d4ec-433b-bbc2-cefc4da2956b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:31.372715 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d0815623-d4ec-433b-bbc2-cefc4da2956b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:31.374238 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d0815623-d4ec-433b-bbc2-cefc4da2956b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:31.375396 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d0815623-d4ec-433b-bbc2-cefc4da2956b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.159588 Aug 03 10:48:31.375952 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 310/602] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:31 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:31.571702 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-267a5f10-1277-4e44-a7d5-aafaaeb4c2f2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:31.572217 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-267a5f10-1277-4e44-a7d5-aafaaeb4c2f2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:31.578381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-267a5f10-1277-4e44-a7d5-aafaaeb4c2f2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:31.578824 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-267a5f10-1277-4e44-a7d5-aafaaeb4c2f2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:31.579580 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-267a5f10-1277-4e44-a7d5-aafaaeb4c2f2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:31.580009 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-267a5f10-1277-4e44-a7d5-aafaaeb4c2f2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:31.708931 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-267a5f10-1277-4e44-a7d5-aafaaeb4c2f2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:31.717137 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-267a5f10-1277-4e44-a7d5-aafaaeb4c2f2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1674 microversion: 2.1 time: 0.150030 Aug 03 10:48:31.717741 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 293/603] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:31 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:31.946236 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4e3aade3-24cf-497c-9bf6-97dc2cc91622 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:31.946838 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4e3aade3-24cf-497c-9bf6-97dc2cc91622 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:31.953458 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e3aade3-24cf-497c-9bf6-97dc2cc91622 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:31.953934 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e3aade3-24cf-497c-9bf6-97dc2cc91622 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:31.954911 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e3aade3-24cf-497c-9bf6-97dc2cc91622 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:31.955346 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e3aade3-24cf-497c-9bf6-97dc2cc91622 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:32.094269 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4e3aade3-24cf-497c-9bf6-97dc2cc91622 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:32.102241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4e3aade3-24cf-497c-9bf6-97dc2cc91622 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.160549 Aug 03 10:48:32.102810 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 311/604] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:31 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:32.398128 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-59130837-9d1b-4169-8794-b3e3b0b7787a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:32.398677 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-59130837-9d1b-4169-8794-b3e3b0b7787a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:32.405209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-59130837-9d1b-4169-8794-b3e3b0b7787a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:32.405687 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-59130837-9d1b-4169-8794-b3e3b0b7787a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:32.406443 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-59130837-9d1b-4169-8794-b3e3b0b7787a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:32.406870 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-59130837-9d1b-4169-8794-b3e3b0b7787a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:32.537728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-59130837-9d1b-4169-8794-b3e3b0b7787a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:32.546308 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-59130837-9d1b-4169-8794-b3e3b0b7787a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:32.547780 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-59130837-9d1b-4169-8794-b3e3b0b7787a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:32.548932 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-59130837-9d1b-4169-8794-b3e3b0b7787a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.154824 Aug 03 10:48:32.549534 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 294/605] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:32 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:32.738598 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9014b599-c69d-4559-9e5f-9b1ef077159a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:32.739209 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9014b599-c69d-4559-9e5f-9b1ef077159a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:32.745237 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9014b599-c69d-4559-9e5f-9b1ef077159a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:32.745723 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9014b599-c69d-4559-9e5f-9b1ef077159a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:32.746486 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9014b599-c69d-4559-9e5f-9b1ef077159a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:32.746923 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9014b599-c69d-4559-9e5f-9b1ef077159a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:32.888740 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9014b599-c69d-4559-9e5f-9b1ef077159a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:32.896257 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9014b599-c69d-4559-9e5f-9b1ef077159a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1674 microversion: 2.1 time: 0.161800 Aug 03 10:48:32.896822 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 312/606] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:32 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:33.125283 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2fb93f2b-e7ed-4c81-b7f5-c303942b3be8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:33.125953 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2fb93f2b-e7ed-4c81-b7f5-c303942b3be8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:33.133054 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fb93f2b-e7ed-4c81-b7f5-c303942b3be8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:33.133568 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fb93f2b-e7ed-4c81-b7f5-c303942b3be8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:33.134385 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fb93f2b-e7ed-4c81-b7f5-c303942b3be8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:33.134831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fb93f2b-e7ed-4c81-b7f5-c303942b3be8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:33.285998 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2fb93f2b-e7ed-4c81-b7f5-c303942b3be8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:33.294676 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2fb93f2b-e7ed-4c81-b7f5-c303942b3be8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.173964 Aug 03 10:48:33.295665 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 295/607] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:33 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:33.573448 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7d0d6bea-458e-4781-b285-8b530e1bc479 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:33.574210 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7d0d6bea-458e-4781-b285-8b530e1bc479 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:33.581016 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d0d6bea-458e-4781-b285-8b530e1bc479 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:33.581574 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d0d6bea-458e-4781-b285-8b530e1bc479 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:33.582349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d0d6bea-458e-4781-b285-8b530e1bc479 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:33.582785 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d0d6bea-458e-4781-b285-8b530e1bc479 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:33.721927 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7d0d6bea-458e-4781-b285-8b530e1bc479 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:33.730568 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7d0d6bea-458e-4781-b285-8b530e1bc479 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:33.732057 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7d0d6bea-458e-4781-b285-8b530e1bc479 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:33.733223 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7d0d6bea-458e-4781-b285-8b530e1bc479 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1723 microversion: 2.20 time: 0.164338 Aug 03 10:48:33.733833 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 313/608] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:33 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:48:33.918393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e81496a2-a207-431b-bb41-f7c83c5b5c40 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:33.918976 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e81496a2-a207-431b-bb41-f7c83c5b5c40 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:33.925885 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e81496a2-a207-431b-bb41-f7c83c5b5c40 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:33.926342 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e81496a2-a207-431b-bb41-f7c83c5b5c40 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:33.927145 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e81496a2-a207-431b-bb41-f7c83c5b5c40 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:33.927583 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e81496a2-a207-431b-bb41-f7c83c5b5c40 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:34.069534 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e81496a2-a207-431b-bb41-f7c83c5b5c40 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:34.088375 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e81496a2-a207-431b-bb41-f7c83c5b5c40 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1674 microversion: 2.1 time: 0.173774 Aug 03 10:48:34.089179 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 296/609] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:33 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:34.316472 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e1f93b75-920e-4328-a497-c9d09d053b42 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:34.317017 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e1f93b75-920e-4328-a497-c9d09d053b42 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:34.324142 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e1f93b75-920e-4328-a497-c9d09d053b42 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:34.324689 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e1f93b75-920e-4328-a497-c9d09d053b42 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:34.325429 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e1f93b75-920e-4328-a497-c9d09d053b42 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:34.326128 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e1f93b75-920e-4328-a497-c9d09d053b42 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:34.463353 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e1f93b75-920e-4328-a497-c9d09d053b42 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:34.472434 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e1f93b75-920e-4328-a497-c9d09d053b42 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.160042 Aug 03 10:48:34.473166 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 314/610] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:34 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:34.743993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-778ae0a4-bcfd-4286-9272-cc2ff87da8fe req-e86733dd-7632-45e9-959d-0f1951a0a47b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5895a291-434d-4b7c-85cd-0264cf37f5f3", "name": "network-vif-deleted", "tag": "971e4968-4040-4784-a0ed-4c689d9711ff"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:34.761074 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-511dad3d-09ac-4fd2-82f4-4003a5efc153 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:34.764609 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-511dad3d-09ac-4fd2-82f4-4003a5efc153 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:34.789308 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-511dad3d-09ac-4fd2-82f4-4003a5efc153 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:34.790450 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-511dad3d-09ac-4fd2-82f4-4003a5efc153 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:34.791510 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-511dad3d-09ac-4fd2-82f4-4003a5efc153 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:34.796479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-778ae0a4-bcfd-4286-9272-cc2ff87da8fe req-e86733dd-7632-45e9-959d-0f1951a0a47b service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:34.797558 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-511dad3d-09ac-4fd2-82f4-4003a5efc153 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:34.811211 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-778ae0a4-bcfd-4286-9272-cc2ff87da8fe req-e86733dd-7632-45e9-959d-0f1951a0a47b service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:34.862425 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-778ae0a4-bcfd-4286-9272-cc2ff87da8fe req-e86733dd-7632-45e9-959d-0f1951a0a47b service nova] Creating event network-vif-deleted:971e4968-4040-4784-a0ed-4c689d9711ff for instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 on hv-cinder-85083 Aug 03 10:48:34.877789 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-778ae0a4-bcfd-4286-9272-cc2ff87da8fe req-e86733dd-7632-45e9-959d-0f1951a0a47b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140103 Aug 03 10:48:34.882510 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 297/611] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:34.909049 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-511dad3d-09ac-4fd2-82f4-4003a5efc153 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:34.921498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-511dad3d-09ac-4fd2-82f4-4003a5efc153 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:34.923058 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-511dad3d-09ac-4fd2-82f4-4003a5efc153 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:34.924225 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-511dad3d-09ac-4fd2-82f4-4003a5efc153 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 200 len: 1366 microversion: 2.20 time: 0.171266 Aug 03 10:48:34.937967 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 315/612] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:34 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:35.113982 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a9bac650-639e-442e-b2cf-dc7b3910990f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:35.117051 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-a9bac650-639e-442e-b2cf-dc7b3910990f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:35.125219 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9bac650-639e-442e-b2cf-dc7b3910990f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:35.125751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9bac650-639e-442e-b2cf-dc7b3910990f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:35.126751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9bac650-639e-442e-b2cf-dc7b3910990f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:35.127487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9bac650-639e-442e-b2cf-dc7b3910990f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:35.147262 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:35.171219 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9bac650-639e-442e-b2cf-dc7b3910990f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:35.171665 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9bac650-639e-442e-b2cf-dc7b3910990f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:35.172103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-a9bac650-639e-442e-b2cf-dc7b3910990f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lazy-loading 'fault' on Instance uuid fbb281c5-ccf1-4de2-99fb-5201efd51b09 {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:48:35.229163 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2b6a7659-486b-47f2-b609-1207dc9e91f0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:35.229776 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2b6a7659-486b-47f2-b609-1207dc9e91f0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:35.234560 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-a9bac650-639e-442e-b2cf-dc7b3910990f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:35.240639 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b6a7659-486b-47f2-b609-1207dc9e91f0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:35.241094 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b6a7659-486b-47f2-b609-1207dc9e91f0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:35.242487 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b6a7659-486b-47f2-b609-1207dc9e91f0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:35.243251 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b6a7659-486b-47f2-b609-1207dc9e91f0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:35.247178 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-a9bac650-639e-442e-b2cf-dc7b3910990f tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 200 len: 1327 microversion: 2.1 time: 0.139489 Aug 03 10:48:35.261726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 298/613] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:35 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 1327 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:35.337752 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-2b6a7659-486b-47f2-b609-1207dc9e91f0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lazy-loading 'services' on Instance uuid c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:48:35.430847 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2b6a7659-486b-47f2-b609-1207dc9e91f0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65/os-volume_attachments/87b38add-a583-4b2c-8c3a-58207dde4199" status: 202 len: 0 microversion: 2.1 time: 0.206279 Aug 03 10:48:35.431443 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 316/614] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 3 10:48:35 2022] DELETE /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65/os-volume_attachments/87b38add-a583-4b2c-8c3a-58207dde4199 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 10:48:35.495694 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-522c5d8e-ada4-4eee-88f3-14cc3501dd0b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:35.496327 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-522c5d8e-ada4-4eee-88f3-14cc3501dd0b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:35.510191 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-522c5d8e-ada4-4eee-88f3-14cc3501dd0b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:35.510655 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-522c5d8e-ada4-4eee-88f3-14cc3501dd0b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:35.514279 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-522c5d8e-ada4-4eee-88f3-14cc3501dd0b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:35.514856 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-522c5d8e-ada4-4eee-88f3-14cc3501dd0b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:35.784045 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-522c5d8e-ada4-4eee-88f3-14cc3501dd0b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:35.794976 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-522c5d8e-ada4-4eee-88f3-14cc3501dd0b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.304713 Aug 03 10:48:35.796003 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 299/615] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:35 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:35.953569 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b371bf92-d899-47a4-862f-78b7f51d2cc8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:35.954271 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b371bf92-d899-47a4-862f-78b7f51d2cc8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:35.963782 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b371bf92-d899-47a4-862f-78b7f51d2cc8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:35.964227 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b371bf92-d899-47a4-862f-78b7f51d2cc8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:35.965000 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b371bf92-d899-47a4-862f-78b7f51d2cc8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:35.965432 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b371bf92-d899-47a4-862f-78b7f51d2cc8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:35.982212 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-b371bf92-d899-47a4-862f-78b7f51d2cc8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] HTTP exception thrown: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b371bf92-d899-47a4-862f-78b7f51d2cc8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Request method failure captured: Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 HTTP/1.1 Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFzbglN1fuK7wx7Z7S3zajNqF7NRslPkJH8P0Ggdz6lHWyTNAsu5ZzCjpssV0Is8iK8ZmQZPOm6yPv-6evm-QsLm35VxxulVrOxmdadnMkVyMKyOTg1xl5gA0YJxIK0mUmrlAOR0oFouEqWdaogNB-BG5zkiF9q6q4_S8EIn2dCg1I Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 157914bad58e4c50b92dfca14ec638aa Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:48:35.984153 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:48:35.985816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_157914bad58e4c50b92dfca14ec638aa", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:48:35.985816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:48:35.985816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 157914bad58e4c50b92dfca14ec638aa Aug 03 10:48:35.985816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:48:35.985816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeShelveTestJSON-2033645781-project Aug 03 10:48:35.985816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:48:35.985816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:48:35.985816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 5744cccc5a224263b71c052dc783e103 Aug 03 10:48:35.985816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2033645781-project Aug 03 10:48:35.985816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:48:35.985816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. Aug 03 10:48:35.985816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': '5895a291-434d-4b7c-85cd-0264cf37f5f3'} Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:48:35.986743 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. Aug 03 10:48:35.988508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:48:35.990092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b371bf92-d899-47a4-862f-78b7f51d2cc8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Returning 404 to user: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:48:35.990758 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b371bf92-d899-47a4-862f-78b7f51d2cc8 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 404 len: 111 microversion: 2.20 time: 0.041554 Aug 03 10:48:35.991424 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 317/616] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:35 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 10:48:35.999950 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-797ae675-59ca-4b5f-8356-29d89a0c2834 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '.version_select at 0x7fbd107048b0>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:36.020837 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-797ae675-59ca-4b5f-8356-29d89a0c2834 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148531242" status: 204 len: 0 microversion: 2.20 time: 0.024832 Aug 03 10:48:36.021804 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 300/617] 10.222.0.47 () {60 vars in 1262 bytes} [Wed Aug 3 10:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148531242 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 10:48:36.271458 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1bccdb59-8135-4499-9e69-ee94a8042cb8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:36.272166 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1bccdb59-8135-4499-9e69-ee94a8042cb8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:36.279116 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1bccdb59-8135-4499-9e69-ee94a8042cb8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:36.279639 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1bccdb59-8135-4499-9e69-ee94a8042cb8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:36.280485 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1bccdb59-8135-4499-9e69-ee94a8042cb8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:36.280983 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1bccdb59-8135-4499-9e69-ee94a8042cb8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:36.298367 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-1bccdb59-8135-4499-9e69-ee94a8042cb8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] HTTP exception thrown: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1bccdb59-8135-4499-9e69-ee94a8042cb8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Request method failure captured: Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 HTTP/1.1 Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFlk9wh8eaqzNROBPOv3fSdMdFyyqtYZ9fS_bPaYaFaJS1qwgKr00hbr9V0W6FuZEXPDWS6At_QzjJZv1hebwhWzb5poWKR4eQDjjv4q0PPI_fGfW_uk-hd10oRDFAfMJvN19agEHC3T9mWCmrkaxFRSVXnBpJELjSWZBGNirfyI5U Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: bcfc3e09588c48299fdf5634cda57416 Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:48:36.300344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:48:36.302002 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bcfc3e09588c48299fdf5634cda57416", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:48:36.302002 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:48:36.302002 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: bcfc3e09588c48299fdf5634cda57416 Aug 03 10:48:36.302002 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:48:36.302002 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeTestJSON-522549250-project Aug 03 10:48:36.302002 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:48:36.302002 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:48:36.302002 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: ebdb81686d804eb3864b97481643fc2b Aug 03 10:48:36.302002 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeTestJSON-522549250-project Aug 03 10:48:36.302002 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:48:36.302002 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. Aug 03 10:48:36.302002 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': 'fbb281c5-ccf1-4de2-99fb-5201efd51b09'} Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:48:36.302926 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. Aug 03 10:48:36.304959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:48:36.306633 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1bccdb59-8135-4499-9e69-ee94a8042cb8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Returning 404 to user: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:48:36.306633 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1bccdb59-8135-4499-9e69-ee94a8042cb8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 404 len: 111 microversion: 2.1 time: 0.038158 Aug 03 10:48:36.306633 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 318/618] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:36 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:48:36.315304 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c5cfcefc-c045-4b33-99b1-340c352be9c5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '.version_select at 0x7fbd10520ca0>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:36.335901 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c5cfcefc-c045-4b33-99b1-340c352be9c5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777545104" status: 202 len: 0 microversion: 2.1 time: 0.025310 Aug 03 10:48:36.336616 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 301/619] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Aug 3 10:48:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777545104 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:48:36.619726 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-58248a70-197c-44d1-800d-80f284419e4a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:36.620503 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-58248a70-197c-44d1-800d-80f284419e4a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:36.628126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-58248a70-197c-44d1-800d-80f284419e4a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:36.628585 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-58248a70-197c-44d1-800d-80f284419e4a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:36.629354 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-58248a70-197c-44d1-800d-80f284419e4a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:36.629817 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-58248a70-197c-44d1-800d-80f284419e4a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:36.662630 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-58248a70-197c-44d1-800d-80f284419e4a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:48:36.765293 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1a96ff7d-7b52-48c2-abc1-0064c9fcb57c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Action: 'create', calling method: .version_select at 0x7fbd10505280>, body: {"keypair": {"name": "tempest-keypair-877194784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvsI24+NjZz3GRAmkPBIpnoMz0JXcQnxxEc+6zQcz9SgIvfyDBKX/ZyadketePp8s+6YctNhI+DuFdlNyRlZISNzbNUPdpUEepP6F3ZazS7a+w6kJLsM3+bxW48GikImA=="}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:36.769672 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-58248a70-197c-44d1-800d-80f284419e4a tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 204 len: 0 microversion: 2.1 time: 0.154512 Aug 03 10:48:36.770748 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 319/620] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:48:36 2022] DELETE /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 10:48:36.780155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-82796cb9-49fa-4415-b6e3-806750741afd tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:36.781014 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-82796cb9-49fa-4415-b6e3-806750741afd tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:36.786572 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-1a96ff7d-7b52-48c2-abc1-0064c9fcb57c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Getting quotas for project 157914bad58e4c50b92dfca14ec638aa. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:48:36.787348 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-82796cb9-49fa-4415-b6e3-806750741afd tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:36.788040 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-82796cb9-49fa-4415-b6e3-806750741afd tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:36.788954 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-82796cb9-49fa-4415-b6e3-806750741afd tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:36.789616 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-82796cb9-49fa-4415-b6e3-806750741afd tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:36.791570 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-1a96ff7d-7b52-48c2-abc1-0064c9fcb57c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Getting quotas for user 5744cccc5a224263b71c052dc783e103 and project 157914bad58e4c50b92dfca14ec638aa. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:48:36.819115 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1a96ff7d-7b52-48c2-abc1-0064c9fcb57c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.057914 Aug 03 10:48:36.820418 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 302/621] 10.222.0.47 () {62 vars in 1200 bytes} [Wed Aug 3 10:48:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 10:48:36.824769 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e162ab74-8c8d-4f3f-9ee3-c32e4eacc83d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:36.825366 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e162ab74-8c8d-4f3f-9ee3-c32e4eacc83d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:36.840343 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e162ab74-8c8d-4f3f-9ee3-c32e4eacc83d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:36.841090 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e162ab74-8c8d-4f3f-9ee3-c32e4eacc83d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:36.842011 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e162ab74-8c8d-4f3f-9ee3-c32e4eacc83d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:36.842524 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e162ab74-8c8d-4f3f-9ee3-c32e4eacc83d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:37.275197 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-82796cb9-49fa-4415-b6e3-806750741afd tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:37.284058 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-82796cb9-49fa-4415-b6e3-806750741afd tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1515 microversion: 2.1 time: 0.508193 Aug 03 10:48:37.284994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 320/622] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:36 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1515 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:37.290114 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-8a8428d1-62fb-4110-bf08-ce058684a086 req-610aa637-285a-4b02-802a-4e4e36bc830e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbb281c5-ccf1-4de2-99fb-5201efd51b09", "name": "network-vif-deleted", "tag": "908667e2-7286-4600-aa74-6161652b25ca"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:37.300232 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-8a8428d1-62fb-4110-bf08-ce058684a086 req-610aa637-285a-4b02-802a-4e4e36bc830e service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:37.300845 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-8a8428d1-62fb-4110-bf08-ce058684a086 req-610aa637-285a-4b02-802a-4e4e36bc830e service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:37.315415 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-8a8428d1-62fb-4110-bf08-ce058684a086 req-610aa637-285a-4b02-802a-4e4e36bc830e service nova] Creating event network-vif-deleted:908667e2-7286-4600-aa74-6161652b25ca for instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 on hv-cinder-85083 Aug 03 10:48:37.322829 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-8a8428d1-62fb-4110-bf08-ce058684a086 req-610aa637-285a-4b02-802a-4e4e36bc830e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036479 Aug 03 10:48:37.323861 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 321/623] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:37.333428 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e162ab74-8c8d-4f3f-9ee3-c32e4eacc83d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:37.344628 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e162ab74-8c8d-4f3f-9ee3-c32e4eacc83d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.523259 Aug 03 10:48:37.345368 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 303/624] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:36 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:37.386802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ed7fa446-41ff-4865-961b-cb51e4488da9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Action: 'create', calling method: .version_select at 0x7fbd1061f700>, body: {"keypair": {"name": "tempest-keypair-919141693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCb0Q/S/gdMGGFkWuB7jNYpQBkZQeN/jAD9B6eYK1c1u8uXnK5jCCW56P1VXvmshzVk1vHfwVMzJiZ1Erc2GLdQWIqx0Lo1M3CHvvbUZ+v6K3UlNMNJ16sI2n05Fo/3WUg=="}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:37.403870 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-ed7fa446-41ff-4865-961b-cb51e4488da9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Getting quotas for project bcfc3e09588c48299fdf5634cda57416. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:48:37.408858 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-ed7fa446-41ff-4865-961b-cb51e4488da9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Getting quotas for user ebdb81686d804eb3864b97481643fc2b and project bcfc3e09588c48299fdf5634cda57416. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:48:37.435069 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ed7fa446-41ff-4865-961b-cb51e4488da9 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053582 Aug 03 10:48:37.436031 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 322/625] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 3 10:48:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:38.306863 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-7a706432-5480-4296-a0d8-ff4dbf80ecda tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:38.307577 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-7a706432-5480-4296-a0d8-ff4dbf80ecda tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:38.323486 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7a706432-5480-4296-a0d8-ff4dbf80ecda tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:38.324131 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7a706432-5480-4296-a0d8-ff4dbf80ecda tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:38.326996 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7a706432-5480-4296-a0d8-ff4dbf80ecda tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:38.327624 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7a706432-5480-4296-a0d8-ff4dbf80ecda tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:38.366565 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-931802f3-908d-4bb0-b33e-553a6199be54 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:38.367910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-931802f3-908d-4bb0-b33e-553a6199be54 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:38.375407 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-931802f3-908d-4bb0-b33e-553a6199be54 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:38.376059 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-931802f3-908d-4bb0-b33e-553a6199be54 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:38.377012 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-931802f3-908d-4bb0-b33e-553a6199be54 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:38.377521 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-931802f3-908d-4bb0-b33e-553a6199be54 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:38.580082 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7a706432-5480-4296-a0d8-ff4dbf80ecda tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:38.588281 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-7a706432-5480-4296-a0d8-ff4dbf80ecda tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1515 microversion: 2.1 time: 0.286821 Aug 03 10:48:38.588851 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 304/626] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:38 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1515 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:38.594611 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1460130303", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8d3428d-2295-4a36-ab41-2839e9ef181a"}], "security_groups": [{"name": "tempest-securitygroup--52764288"}], "key_name": "tempest-keypair-877194784", "user_data": "}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:38.800193 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.network.neutron [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] validate_networks() for [('d8d3428d-2295-4a36-ab41-2839e9ef181a', None, None, None, None, None)] {{(pid=124389) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:48:38.950387 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-931802f3-908d-4bb0-b33e-553a6199be54 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:38.959482 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-931802f3-908d-4bb0-b33e-553a6199be54 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.596677 Aug 03 10:48:38.974348 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 323/627] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:38 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:38.981076 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-66081021", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc3a73d1-f127-40ea-a3ea-562e46bab0d8"}], "security_groups": [{"name": "tempest-securitygroup--525680591"}], "key_name": "tempest-keypair-919141693", "user_data": "}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:39.122117 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] validate_networks() for [('bc3a73d1-f127-40ea-a3ea-562e46bab0d8', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:48:39.408693 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Flavor limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:48:39.409113 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Image limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:48:39.409738 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Flavor pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:48:39.410127 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Image pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:48:39.410529 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:48:39.420911 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:39.421351 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:39.422386 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:39.423019 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:39.441720 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Getting quotas for project 157914bad58e4c50b92dfca14ec638aa. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:48:39.445396 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Getting quotas for user 5744cccc5a224263b71c052dc783e103 and project 157914bad58e4c50b92dfca14ec638aa. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:48:39.480960 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Going to run 1 instances... {{(pid=124389) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:48:39.482712 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:48:39.567565 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e3b0a4c6-e2de-46a0-bb9c-67fc56632884 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.977158 Aug 03 10:48:39.570189 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 305/628] 10.222.0.47 () {62 vars in 1188 bytes} [Wed Aug 3 10:48:38 2022] POST /compute/v2.1/servers => generated 400 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 10:48:39.586017 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4cda6d92-f31a-4392-bb6e-89fe8d80dece tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:39.595958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4cda6d92-f31a-4392-bb6e-89fe8d80dece tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:39.684547 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:48:39.685016 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:48:39.685441 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:48:39.685879 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:48:39.686292 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:48:39.702770 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:39.703518 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:39.704441 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:39.705091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:39.727849 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Getting quotas for project bcfc3e09588c48299fdf5634cda57416. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:48:39.732604 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Getting quotas for user ebdb81686d804eb3864b97481643fc2b and project bcfc3e09588c48299fdf5634cda57416. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:48:39.745393 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:48:39.748134 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:48:39.783929 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4cda6d92-f31a-4392-bb6e-89fe8d80dece tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:39.794261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4cda6d92-f31a-4392-bb6e-89fe8d80dece tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:39.795656 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4cda6d92-f31a-4392-bb6e-89fe8d80dece tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:39.796733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-4cda6d92-f31a-4392-bb6e-89fe8d80dece tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1281 microversion: 2.20 time: 0.220767 Aug 03 10:48:39.797310 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 306/629] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:39 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1281 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:39.806899 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-bca6c2f9-f819-4b65-9193-fdfcc5497d89 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:39.807687 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR oslo.messaging._drivers.impl_rabbit [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [027a2fe7-d474-4289-bb4d-20efe5ec1f84] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 10:48:39.808193 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-bca6c2f9-f819-4b65-9193-fdfcc5497d89 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:39.814461 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bca6c2f9-f819-4b65-9193-fdfcc5497d89 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:39.814915 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bca6c2f9-f819-4b65-9193-fdfcc5497d89 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:39.815684 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bca6c2f9-f819-4b65-9193-fdfcc5497d89 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:39.816114 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bca6c2f9-f819-4b65-9193-fdfcc5497d89 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:39.957804 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-bca6c2f9-f819-4b65-9193-fdfcc5497d89 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:39.966400 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-bca6c2f9-f819-4b65-9193-fdfcc5497d89 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1515 microversion: 2.1 time: 0.164209 Aug 03 10:48:39.966964 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 307/630] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:39 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:39.981454 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-da63e5cf-690d-4ed3-9d4d-2f192506b311 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:39.982095 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-da63e5cf-690d-4ed3-9d4d-2f192506b311 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:39.988784 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-da63e5cf-690d-4ed3-9d4d-2f192506b311 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:39.989232 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-da63e5cf-690d-4ed3-9d4d-2f192506b311 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:39.990216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-da63e5cf-690d-4ed3-9d4d-2f192506b311 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:39.990649 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-da63e5cf-690d-4ed3-9d4d-2f192506b311 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:40.133724 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-da63e5cf-690d-4ed3-9d4d-2f192506b311 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:40.143235 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-da63e5cf-690d-4ed3-9d4d-2f192506b311 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1736 microversion: 2.1 time: 0.165601 Aug 03 10:48:40.144140 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 308/631] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:39 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:48:40.282652 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-61663ee2-765e-49cd-81df-62b2fe07af9b req-04acc10a-0300-4d30-b6ff-c6accacbb3ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4583b6a-2fb9-4b2b-acc3-02b6054f4b65", "name": "network-vif-deleted", "tag": "022a56f1-f212-4e83-b4c7-7f7b6600e674"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:40.293615 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-61663ee2-765e-49cd-81df-62b2fe07af9b req-04acc10a-0300-4d30-b6ff-c6accacbb3ce service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:40.294270 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-61663ee2-765e-49cd-81df-62b2fe07af9b req-04acc10a-0300-4d30-b6ff-c6accacbb3ce service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:40.307058 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-61663ee2-765e-49cd-81df-62b2fe07af9b req-04acc10a-0300-4d30-b6ff-c6accacbb3ce service nova] Creating event network-vif-deleted:022a56f1-f212-4e83-b4c7-7f7b6600e674 for instance c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 on hv-cinder-85083 Aug 03 10:48:40.312071 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-61663ee2-765e-49cd-81df-62b2fe07af9b req-04acc10a-0300-4d30-b6ff-c6accacbb3ce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033630 Aug 03 10:48:40.312696 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 309/632] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:40.815262 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO oslo.messaging._drivers.impl_rabbit [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [027a2fe7-d474-4289-bb4d-20efe5ec1f84] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 38030. Aug 03 10:48:40.819584 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-19c6dedf-3815-4329-844c-a1d7fa8ca159 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.842679 Aug 03 10:48:40.820409 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 324/633] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:48:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 10:48:40.823955 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-46417f92-d4fd-48bd-9e00-9e2f7d4c831d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:40.824679 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-46417f92-d4fd-48bd-9e00-9e2f7d4c831d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:40.832646 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-46417f92-d4fd-48bd-9e00-9e2f7d4c831d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:40.833070 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-46417f92-d4fd-48bd-9e00-9e2f7d4c831d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:40.834022 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-46417f92-d4fd-48bd-9e00-9e2f7d4c831d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:40.834462 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-22ae005e-632b-4ec2-aac9-940741064c38 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:40.834605 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-46417f92-d4fd-48bd-9e00-9e2f7d4c831d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:40.835865 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-22ae005e-632b-4ec2-aac9-940741064c38 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:40.904908 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-22ae005e-632b-4ec2-aac9-940741064c38 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:40.912967 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-22ae005e-632b-4ec2-aac9-940741064c38 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1235 microversion: 2.1 time: 0.084626 Aug 03 10:48:40.914490 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 325/634] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:40 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1235 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:48:40.923144 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-46417f92-d4fd-48bd-9e00-9e2f7d4c831d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:40.931651 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-46417f92-d4fd-48bd-9e00-9e2f7d4c831d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:40.933256 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-46417f92-d4fd-48bd-9e00-9e2f7d4c831d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:40.934479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-46417f92-d4fd-48bd-9e00-9e2f7d4c831d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1333 microversion: 2.20 time: 0.117606 Aug 03 10:48:40.935346 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 310/635] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:40 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1333 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:48:40.987864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7f21d13b-e9a4-4423-8eb0-40010f1a97c0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:40.988736 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7f21d13b-e9a4-4423-8eb0-40010f1a97c0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:40.990976 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:40.998050 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7f21d13b-e9a4-4423-8eb0-40010f1a97c0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:40.998844 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7f21d13b-e9a4-4423-8eb0-40010f1a97c0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:41.000001 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7f21d13b-e9a4-4423-8eb0-40010f1a97c0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:41.000593 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7f21d13b-e9a4-4423-8eb0-40010f1a97c0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:41.041188 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7f21d13b-e9a4-4423-8eb0-40010f1a97c0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:41.041623 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7f21d13b-e9a4-4423-8eb0-40010f1a97c0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:41.042245 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-7f21d13b-e9a4-4423-8eb0-40010f1a97c0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lazy-loading 'fault' on Instance uuid c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:48:41.095045 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7f21d13b-e9a4-4423-8eb0-40010f1a97c0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:41.103362 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7f21d13b-e9a4-4423-8eb0-40010f1a97c0 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1309 microversion: 2.1 time: 0.119480 Aug 03 10:48:41.104276 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 326/636] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:40 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1309 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:41.164862 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-19972699-7f4e-4979-8d3a-3fc2dad1be95 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:41.165604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-19972699-7f4e-4979-8d3a-3fc2dad1be95 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:41.171893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-19972699-7f4e-4979-8d3a-3fc2dad1be95 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:41.172448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-19972699-7f4e-4979-8d3a-3fc2dad1be95 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:41.173733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-19972699-7f4e-4979-8d3a-3fc2dad1be95 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:41.173963 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-19972699-7f4e-4979-8d3a-3fc2dad1be95 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:41.311667 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-19972699-7f4e-4979-8d3a-3fc2dad1be95 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:41.320305 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-19972699-7f4e-4979-8d3a-3fc2dad1be95 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1716 microversion: 2.1 time: 0.159924 Aug 03 10:48:41.320871 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 311/637] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:41 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:48:41.429440 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0a12d13e-ca7d-4207-9b2e-588abb4b323e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:41.429951 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0a12d13e-ca7d-4207-9b2e-588abb4b323e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:41.436449 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a12d13e-ca7d-4207-9b2e-588abb4b323e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:41.436892 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a12d13e-ca7d-4207-9b2e-588abb4b323e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:41.437759 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a12d13e-ca7d-4207-9b2e-588abb4b323e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:41.438194 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a12d13e-ca7d-4207-9b2e-588abb4b323e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:41.530817 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-0a12d13e-ca7d-4207-9b2e-588abb4b323e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] HTTP exception thrown: Cannot 'detach_volume' instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 while it is in vm_state rescued Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0a12d13e-ca7d-4207-9b2e-588abb4b323e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Request method failure captured: Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: DELETE /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-volume_attachments/cc559fe6-de81-4a57-9dc2-869907d32217 HTTP/1.1 Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lF2pOWmhCbmjifspfqKpHzAxIhbE2uFuR1reDQeN7S2zka5yP-6of9k_LGD6SROhSzwAA7evRUOk4uaXIt5tYTAzEQECkaYCrzI0Aqtaz-VJZl5OF72sMI3bRVG5PZbcMDIsDqI_MOs7HwjGb9gR7eJuQbd-puQcPhNc0yJtZc7Oks Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: ca8789771e8a4505866424b6c7748291 Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168500966 Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:48:41.532442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:48:41.534025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca8789771e8a4505866424b6c7748291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca8789771e8a4505866424b6c7748291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca8789771e8a4505866424b6c7748291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca8789771e8a4505866424b6c7748291", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:48:41.534025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168500966 Aug 03 10:48:41.534025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: ca8789771e8a4505866424b6c7748291 Aug 03 10:48:41.534025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168500966 Aug 03 10:48:41.534025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-ServerRescueNegativeTestJSON-168500966-project Aug 03 10:48:41.534025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:48:41.534025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:48:41.534025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: a5e714aad25f4fda8acf767ad7e2490b Aug 03 10:48:41.534025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168500966-project Aug 03 10:48:41.534025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:48:41.534025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Cannot 'detach_volume' instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 while it is in vm_state rescued Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'server_id': '00b0240d-3638-48b2-a7f3-2269dd2aba05', 'id': 'cc559fe6-de81-4a57-9dc2-869907d32217'} Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:48:41.534794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 while it is in vm_state rescued Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 while it is in vm_state rescued Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:48:41.536248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0a12d13e-ca7d-4207-9b2e-588abb4b323e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Returning 409 to user: Cannot 'detach_volume' instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 while it is in vm_state rescued {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:48:41.537413 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0a12d13e-ca7d-4207-9b2e-588abb4b323e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "DELETE /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-volume_attachments/cc559fe6-de81-4a57-9dc2-869907d32217" status: 409 len: 152 microversion: 2.1 time: 0.108564 Aug 03 10:48:41.537413 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 327/638] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 3 10:48:41 2022] DELETE /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-volume_attachments/cc559fe6-de81-4a57-9dc2-869907d32217 => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 10:48:41.542783 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-dca8ac48-13c3-4add-8051-ed86d5e6efd8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:41.543311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-dca8ac48-13c3-4add-8051-ed86d5e6efd8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:41.549435 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dca8ac48-13c3-4add-8051-ed86d5e6efd8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:41.550018 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dca8ac48-13c3-4add-8051-ed86d5e6efd8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:41.550781 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dca8ac48-13c3-4add-8051-ed86d5e6efd8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:41.551234 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dca8ac48-13c3-4add-8051-ed86d5e6efd8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:41.621638 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-dca8ac48-13c3-4add-8051-ed86d5e6efd8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "POST /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/action" status: 202 len: 0 microversion: 2.1 time: 0.082484 Aug 03 10:48:41.622394 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 312/639] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 3 10:48:41 2022] POST /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:48:41.631036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-77b9a77d-4c34-4c40-9b5a-b049c3f0321f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:41.631658 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-77b9a77d-4c34-4c40-9b5a-b049c3f0321f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:41.638385 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-77b9a77d-4c34-4c40-9b5a-b049c3f0321f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:41.638832 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-77b9a77d-4c34-4c40-9b5a-b049c3f0321f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:41.639607 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-77b9a77d-4c34-4c40-9b5a-b049c3f0321f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:41.640043 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-77b9a77d-4c34-4c40-9b5a-b049c3f0321f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:41.791083 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-77b9a77d-4c34-4c40-9b5a-b049c3f0321f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:41.801558 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-77b9a77d-4c34-4c40-9b5a-b049c3f0321f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1724 microversion: 2.1 time: 0.174766 Aug 03 10:48:41.802139 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 328/640] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:41 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:41.935906 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-50b12b50-ce25-495f-b4c0-688a2671c4eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:41.936659 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-50b12b50-ce25-495f-b4c0-688a2671c4eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:41.942892 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-50b12b50-ce25-495f-b4c0-688a2671c4eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:41.943345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-50b12b50-ce25-495f-b4c0-688a2671c4eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:41.944208 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-50b12b50-ce25-495f-b4c0-688a2671c4eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:41.945236 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-50b12b50-ce25-495f-b4c0-688a2671c4eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:41.956482 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0689fd4d-c403-4fb2-8c07-6e1b45e54357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:41.957190 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0689fd4d-c403-4fb2-8c07-6e1b45e54357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:41.963405 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0689fd4d-c403-4fb2-8c07-6e1b45e54357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:41.963934 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0689fd4d-c403-4fb2-8c07-6e1b45e54357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:41.964777 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0689fd4d-c403-4fb2-8c07-6e1b45e54357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:41.965284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0689fd4d-c403-4fb2-8c07-6e1b45e54357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:41.970425 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:42.010026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-50b12b50-ce25-495f-b4c0-688a2671c4eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:42.017848 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-50b12b50-ce25-495f-b4c0-688a2671c4eb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1231 microversion: 2.1 time: 0.086461 Aug 03 10:48:42.018485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 313/641] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:41 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1231 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:42.039355 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0689fd4d-c403-4fb2-8c07-6e1b45e54357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:42.047604 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0689fd4d-c403-4fb2-8c07-6e1b45e54357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:42.049116 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0689fd4d-c403-4fb2-8c07-6e1b45e54357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:42.050466 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0689fd4d-c403-4fb2-8c07-6e1b45e54357 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1351 microversion: 2.20 time: 0.097950 Aug 03 10:48:42.051008 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 329/642] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:41 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:42.127032 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-63f1650e-9ced-4778-b2e8-961d3ae03367 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:42.128277 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-63f1650e-9ced-4778-b2e8-961d3ae03367 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:42.139194 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-63f1650e-9ced-4778-b2e8-961d3ae03367 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:42.139916 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-63f1650e-9ced-4778-b2e8-961d3ae03367 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:42.140935 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-63f1650e-9ced-4778-b2e8-961d3ae03367 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:42.141705 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-63f1650e-9ced-4778-b2e8-961d3ae03367 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:42.180502 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-63f1650e-9ced-4778-b2e8-961d3ae03367 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:42.180975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-63f1650e-9ced-4778-b2e8-961d3ae03367 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:42.181432 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-63f1650e-9ced-4778-b2e8-961d3ae03367 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lazy-loading 'fault' on Instance uuid c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:48:42.242617 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-63f1650e-9ced-4778-b2e8-961d3ae03367 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92485e486d53488eabf12105d1048e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d4304db6d342e4ada925b6784e6d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:42.250503 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-63f1650e-9ced-4778-b2e8-961d3ae03367 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 200 len: 1309 microversion: 2.1 time: 0.128898 Aug 03 10:48:42.251081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 314/643] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:42 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 1309 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:42.826445 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-357e4338-7102-4c67-8593-dcd3e01f6e9d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:42.827688 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-357e4338-7102-4c67-8593-dcd3e01f6e9d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:42.834641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-357e4338-7102-4c67-8593-dcd3e01f6e9d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:42.835664 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-357e4338-7102-4c67-8593-dcd3e01f6e9d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:42.836440 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-357e4338-7102-4c67-8593-dcd3e01f6e9d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:42.836950 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-357e4338-7102-4c67-8593-dcd3e01f6e9d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:43.001621 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-357e4338-7102-4c67-8593-dcd3e01f6e9d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:43.014688 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-357e4338-7102-4c67-8593-dcd3e01f6e9d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1724 microversion: 2.1 time: 0.193384 Aug 03 10:48:43.015900 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 330/644] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:42 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:43.047286 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-80ec3444-607f-404d-ade5-0c7542159bd2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:43.047969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-80ec3444-607f-404d-ade5-0c7542159bd2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:43.057546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-80ec3444-607f-404d-ade5-0c7542159bd2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:43.058767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-80ec3444-607f-404d-ade5-0c7542159bd2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:43.059763 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-80ec3444-607f-404d-ade5-0c7542159bd2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:43.060541 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-80ec3444-607f-404d-ade5-0c7542159bd2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:43.074270 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f5312960-ccee-42c0-b25c-3cde2e17c59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:43.075222 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f5312960-ccee-42c0-b25c-3cde2e17c59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:43.081452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f5312960-ccee-42c0-b25c-3cde2e17c59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:43.082201 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f5312960-ccee-42c0-b25c-3cde2e17c59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:43.083191 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f5312960-ccee-42c0-b25c-3cde2e17c59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:43.083781 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f5312960-ccee-42c0-b25c-3cde2e17c59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:43.200852 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-80ec3444-607f-404d-ade5-0c7542159bd2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:43.213000 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-80ec3444-607f-404d-ade5-0c7542159bd2 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1295 microversion: 2.1 time: 0.177533 Aug 03 10:48:43.214259 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 315/645] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:43 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1295 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:43.273353 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-eb271fe7-18b9-4ea7-ab54-9e25dd1b72b5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:43.274134 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-eb271fe7-18b9-4ea7-ab54-9e25dd1b72b5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] [instance: c4583b6a-2fb9-4b2b-acc3-02b6054f4b65] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:43.276393 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f5312960-ccee-42c0-b25c-3cde2e17c59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:43.283148 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-eb271fe7-18b9-4ea7-ab54-9e25dd1b72b5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:43.283907 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-eb271fe7-18b9-4ea7-ab54-9e25dd1b72b5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:43.284850 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-eb271fe7-18b9-4ea7-ab54-9e25dd1b72b5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:43.285364 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f5312960-ccee-42c0-b25c-3cde2e17c59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:43.285531 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-eb271fe7-18b9-4ea7-ab54-9e25dd1b72b5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:43.286911 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f5312960-ccee-42c0-b25c-3cde2e17c59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:43.288070 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f5312960-ccee-42c0-b25c-3cde2e17c59c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1405 microversion: 2.20 time: 0.217731 Aug 03 10:48:43.288631 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 331/646] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:43 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:43.320551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-eb271fe7-18b9-4ea7-ab54-9e25dd1b72b5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] HTTP exception thrown: Instance c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 could not be found. Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-eb271fe7-18b9-4ea7-ab54-9e25dd1b72b5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Request method failure captured: Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 HTTP/1.1 Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lIFXLkzCONBalgaATFLgV2HGjPWPp5gWFJZho0uVR-f7-BM3pO7WVtbXRaqvU3a1tQkKFwnIRSAq-QCQ5HzTS6myN3OdPl68RpFqJgOcj8xTY0cPuLAKVjiZ_KGEbCwyiM210rwbZgmbiDl5U2Hkbtj3WYix2N7Asulqu1ceiY4C64 Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: f9d4304db6d342e4ada925b6784e6d0d Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-VolumesSnapshotTestJSON-10231931 Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:48:43.322242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:48:43.323778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9d4304db6d342e4ada925b6784e6d0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f9d4304db6d342e4ada925b6784e6d0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9d4304db6d342e4ada925b6784e6d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f9d4304db6d342e4ada925b6784e6d0d", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:48:43.323778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-VolumesSnapshotTestJSON-10231931 Aug 03 10:48:43.323778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: f9d4304db6d342e4ada925b6784e6d0d Aug 03 10:48:43.323778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-10231931 Aug 03 10:48:43.323778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-VolumesSnapshotTestJSON-10231931-project Aug 03 10:48:43.323778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:48:43.323778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:48:43.323778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 92485e486d53488eabf12105d1048e13 Aug 03 10:48:43.323778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-VolumesSnapshotTestJSON-10231931-project Aug 03 10:48:43.323778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:48:43.323778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 could not be found. Aug 03 10:48:43.323778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': 'c4583b6a-2fb9-4b2b-acc3-02b6054f4b65'} Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 could not be found. Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:48:43.324650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 could not be found. Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 could not be found. Aug 03 10:48:43.326278 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:48:43.327535 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-eb271fe7-18b9-4ea7-ab54-9e25dd1b72b5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] Returning 404 to user: Instance c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:48:43.327535 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-eb271fe7-18b9-4ea7-ab54-9e25dd1b72b5 tempest-VolumesSnapshotTestJSON-10231931 tempest-VolumesSnapshotTestJSON-10231931-project] 10.222.0.47 "GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65" status: 404 len: 111 microversion: 2.1 time: 0.055361 Aug 03 10:48:43.327535 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 316/647] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:43 2022] GET /compute/v2.1/servers/c4583b6a-2fb9-4b2b-acc3-02b6054f4b65 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:48:44.041988 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f7def6aa-b1d4-46e2-a35b-75f5bb0c45eb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:44.042666 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f7def6aa-b1d4-46e2-a35b-75f5bb0c45eb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:44.049213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f7def6aa-b1d4-46e2-a35b-75f5bb0c45eb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:44.049895 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f7def6aa-b1d4-46e2-a35b-75f5bb0c45eb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:44.050671 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f7def6aa-b1d4-46e2-a35b-75f5bb0c45eb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:44.051111 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f7def6aa-b1d4-46e2-a35b-75f5bb0c45eb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:44.190032 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f7def6aa-b1d4-46e2-a35b-75f5bb0c45eb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:44.199092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f7def6aa-b1d4-46e2-a35b-75f5bb0c45eb tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1724 microversion: 2.1 time: 0.161942 Aug 03 10:48:44.199774 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 332/648] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:44 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:44.239289 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-919815ac-486e-4b0c-b72d-73f8ea553791 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:44.239894 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-919815ac-486e-4b0c-b72d-73f8ea553791 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:44.246370 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-919815ac-486e-4b0c-b72d-73f8ea553791 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:44.246810 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-919815ac-486e-4b0c-b72d-73f8ea553791 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:44.247572 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-919815ac-486e-4b0c-b72d-73f8ea553791 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:44.248018 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-919815ac-486e-4b0c-b72d-73f8ea553791 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:44.311485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-919815ac-486e-4b0c-b72d-73f8ea553791 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:44.314003 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ab939c4b-913f-4c03-911e-d480f426e136 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:44.314974 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ab939c4b-913f-4c03-911e-d480f426e136 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:44.322355 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ab939c4b-913f-4c03-911e-d480f426e136 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:44.322567 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-919815ac-486e-4b0c-b72d-73f8ea553791 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1293 microversion: 2.1 time: 0.087111 Aug 03 10:48:44.322795 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ab939c4b-913f-4c03-911e-d480f426e136 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:44.333492 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 317/649] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:44 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:44.334628 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ab939c4b-913f-4c03-911e-d480f426e136 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:44.335774 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ab939c4b-913f-4c03-911e-d480f426e136 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:44.482902 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ab939c4b-913f-4c03-911e-d480f426e136 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:44.492228 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ab939c4b-913f-4c03-911e-d480f426e136 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:44.493860 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ab939c4b-913f-4c03-911e-d480f426e136 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:44.495131 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ab939c4b-913f-4c03-911e-d480f426e136 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1405 microversion: 2.20 time: 0.185361 Aug 03 10:48:44.495782 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 333/650] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:44 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:48:44.731276 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-3894a1a7-97a0-40f6-9782-57857440b781 req-53ea22ff-e3e2-4e89-a30f-61072ccbfcc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99cbe8d4-0681-4b94-a774-1f0067f69263", "tag": "5c7bb60f-6fc3-4d3d-bda1-d77d9a5e91fb"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:44.761010 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-3894a1a7-97a0-40f6-9782-57857440b781 req-53ea22ff-e3e2-4e89-a30f-61072ccbfcc8 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:44.761774 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-3894a1a7-97a0-40f6-9782-57857440b781 req-53ea22ff-e3e2-4e89-a30f-61072ccbfcc8 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:44.778300 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-3894a1a7-97a0-40f6-9782-57857440b781 req-53ea22ff-e3e2-4e89-a30f-61072ccbfcc8 service nova] Creating event network-changed:5c7bb60f-6fc3-4d3d-bda1-d77d9a5e91fb for instance 99cbe8d4-0681-4b94-a774-1f0067f69263 on hv-cinder-85083 Aug 03 10:48:44.783972 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-3894a1a7-97a0-40f6-9782-57857440b781 req-53ea22ff-e3e2-4e89-a30f-61072ccbfcc8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058416 Aug 03 10:48:44.785519 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 318/651] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:45.220249 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ee54c095-6fbb-4b66-87f2-5aecd8a02940 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:45.220922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ee54c095-6fbb-4b66-87f2-5aecd8a02940 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:45.227209 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee54c095-6fbb-4b66-87f2-5aecd8a02940 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:45.227739 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee54c095-6fbb-4b66-87f2-5aecd8a02940 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:45.228539 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee54c095-6fbb-4b66-87f2-5aecd8a02940 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:45.229045 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee54c095-6fbb-4b66-87f2-5aecd8a02940 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:45.364192 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ee54c095-6fbb-4b66-87f2-5aecd8a02940 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:45.364318 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-01463d52-38a0-47ee-ab03-a32c75b77803 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:45.366870 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-01463d52-38a0-47ee-ab03-a32c75b77803 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:45.374637 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ee54c095-6fbb-4b66-87f2-5aecd8a02940 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1724 microversion: 2.1 time: 0.158156 Aug 03 10:48:45.374906 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-01463d52-38a0-47ee-ab03-a32c75b77803 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:45.375357 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-01463d52-38a0-47ee-ab03-a32c75b77803 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:45.375645 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 334/652] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:45 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:45.376138 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-01463d52-38a0-47ee-ab03-a32c75b77803 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:45.376641 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-01463d52-38a0-47ee-ab03-a32c75b77803 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:45.516222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-01463d52-38a0-47ee-ab03-a32c75b77803 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:45.517456 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-04951da3-9653-452f-b0f9-44fc25fb355a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:45.518088 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-04951da3-9653-452f-b0f9-44fc25fb355a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:45.524387 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-01463d52-38a0-47ee-ab03-a32c75b77803 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1360 microversion: 2.1 time: 0.176303 Aug 03 10:48:45.524914 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-04951da3-9653-452f-b0f9-44fc25fb355a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:45.525367 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-04951da3-9653-452f-b0f9-44fc25fb355a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:45.526179 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-04951da3-9653-452f-b0f9-44fc25fb355a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:45.526620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-04951da3-9653-452f-b0f9-44fc25fb355a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:45.537977 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 319/653] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:45 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1360 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:45.661821 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-04951da3-9653-452f-b0f9-44fc25fb355a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:45.670085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-04951da3-9653-452f-b0f9-44fc25fb355a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:45.671619 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-04951da3-9653-452f-b0f9-44fc25fb355a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:45.672724 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-04951da3-9653-452f-b0f9-44fc25fb355a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1405 microversion: 2.20 time: 0.159117 Aug 03 10:48:45.673279 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 335/654] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:45 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:46.396914 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-fc2a61ce-9654-4351-9634-3b7253ff83a5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:46.398065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-fc2a61ce-9654-4351-9634-3b7253ff83a5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:46.404527 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fc2a61ce-9654-4351-9634-3b7253ff83a5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:46.404968 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fc2a61ce-9654-4351-9634-3b7253ff83a5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:46.405748 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fc2a61ce-9654-4351-9634-3b7253ff83a5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:46.406176 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fc2a61ce-9654-4351-9634-3b7253ff83a5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:46.408803 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:46.543067 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fc2a61ce-9654-4351-9634-3b7253ff83a5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:46.545030 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-01d695df-2e88-4396-81c6-ffafe131cd96 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:46.545664 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-01d695df-2e88-4396-81c6-ffafe131cd96 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:46.551835 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-fc2a61ce-9654-4351-9634-3b7253ff83a5 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1724 microversion: 2.1 time: 0.158653 Aug 03 10:48:46.552440 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 320/655] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:46 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:46.553235 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-01d695df-2e88-4396-81c6-ffafe131cd96 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:46.553731 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-01d695df-2e88-4396-81c6-ffafe131cd96 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:46.554509 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-01d695df-2e88-4396-81c6-ffafe131cd96 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:46.554943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-01d695df-2e88-4396-81c6-ffafe131cd96 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:46.682924 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-01d695df-2e88-4396-81c6-ffafe131cd96 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:46.691192 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-01d695df-2e88-4396-81c6-ffafe131cd96 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1360 microversion: 2.1 time: 0.149803 Aug 03 10:48:46.691990 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 336/656] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:46 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:48:46.696771 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1a39a1ba-1d2d-496d-9c24-175f4b7e031f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:46.697044 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-1a39a1ba-1d2d-496d-9c24-175f4b7e031f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:46.703820 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1a39a1ba-1d2d-496d-9c24-175f4b7e031f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:46.704267 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1a39a1ba-1d2d-496d-9c24-175f4b7e031f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:46.705037 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1a39a1ba-1d2d-496d-9c24-175f4b7e031f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:46.705502 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1a39a1ba-1d2d-496d-9c24-175f4b7e031f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:46.801126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-c7eef5de-60d6-47f2-a1be-b47a74fb68ba req-25dc7c33-9231-4e8b-a35c-d22ecbc1b766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "310651c9-a8fa-4169-950a-581cfdedf786", "tag": "dade6b18-ba20-4633-971b-0a3be895b570"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:46.810668 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-c7eef5de-60d6-47f2-a1be-b47a74fb68ba req-25dc7c33-9231-4e8b-a35c-d22ecbc1b766 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:46.811319 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-c7eef5de-60d6-47f2-a1be-b47a74fb68ba req-25dc7c33-9231-4e8b-a35c-d22ecbc1b766 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:46.824252 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-c7eef5de-60d6-47f2-a1be-b47a74fb68ba req-25dc7c33-9231-4e8b-a35c-d22ecbc1b766 service nova] Creating event network-changed:dade6b18-ba20-4633-971b-0a3be895b570 for instance 310651c9-a8fa-4169-950a-581cfdedf786 on hv-cinder-85083 Aug 03 10:48:46.829285 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-c7eef5de-60d6-47f2-a1be-b47a74fb68ba req-25dc7c33-9231-4e8b-a35c-d22ecbc1b766 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031764 Aug 03 10:48:46.829934 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 337/657] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:48:46.836800 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1a39a1ba-1d2d-496d-9c24-175f4b7e031f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:46.845042 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1a39a1ba-1d2d-496d-9c24-175f4b7e031f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:46.846587 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1a39a1ba-1d2d-496d-9c24-175f4b7e031f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:46.847706 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1a39a1ba-1d2d-496d-9c24-175f4b7e031f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1405 microversion: 2.20 time: 0.155799 Aug 03 10:48:46.848268 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 321/658] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:46 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:47.573212 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-76f6b7ae-6ea5-42bf-9c56-69d973e042e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:47.573974 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-76f6b7ae-6ea5-42bf-9c56-69d973e042e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:47.580227 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76f6b7ae-6ea5-42bf-9c56-69d973e042e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:47.580675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76f6b7ae-6ea5-42bf-9c56-69d973e042e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:47.581509 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76f6b7ae-6ea5-42bf-9c56-69d973e042e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:47.581903 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76f6b7ae-6ea5-42bf-9c56-69d973e042e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:47.712684 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1af3d248-ec88-4e9a-9dba-3b9f4527e13a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:47.715192 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-1af3d248-ec88-4e9a-9dba-3b9f4527e13a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:47.715800 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-76f6b7ae-6ea5-42bf-9c56-69d973e042e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:47.720314 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1af3d248-ec88-4e9a-9dba-3b9f4527e13a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:47.722288 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1af3d248-ec88-4e9a-9dba-3b9f4527e13a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:47.722288 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1af3d248-ec88-4e9a-9dba-3b9f4527e13a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:47.722288 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1af3d248-ec88-4e9a-9dba-3b9f4527e13a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:47.725370 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-76f6b7ae-6ea5-42bf-9c56-69d973e042e8 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1724 microversion: 2.1 time: 0.156693 Aug 03 10:48:47.726704 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 338/659] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:47 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:48:47.854280 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1af3d248-ec88-4e9a-9dba-3b9f4527e13a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:47.862755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1af3d248-ec88-4e9a-9dba-3b9f4527e13a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1360 microversion: 2.1 time: 0.154099 Aug 03 10:48:47.863340 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 322/660] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:47 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:48:47.869850 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c60e70b6-21e8-4b80-ab5d-91a9716af8e5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:47.870534 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c60e70b6-21e8-4b80-ab5d-91a9716af8e5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:47.876820 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c60e70b6-21e8-4b80-ab5d-91a9716af8e5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:47.877266 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c60e70b6-21e8-4b80-ab5d-91a9716af8e5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:47.878096 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c60e70b6-21e8-4b80-ab5d-91a9716af8e5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:47.878528 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c60e70b6-21e8-4b80-ab5d-91a9716af8e5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:48.011524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c60e70b6-21e8-4b80-ab5d-91a9716af8e5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:48.023181 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c60e70b6-21e8-4b80-ab5d-91a9716af8e5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:48.024704 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c60e70b6-21e8-4b80-ab5d-91a9716af8e5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:48.025939 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c60e70b6-21e8-4b80-ab5d-91a9716af8e5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1405 microversion: 2.20 time: 0.159918 Aug 03 10:48:48.026771 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 339/661] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:47 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:48:48.748293 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-090b1014-7b9d-4ff4-bc79-16e79166f301 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:48.748921 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-090b1014-7b9d-4ff4-bc79-16e79166f301 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:48.755610 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-090b1014-7b9d-4ff4-bc79-16e79166f301 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:48.755981 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-090b1014-7b9d-4ff4-bc79-16e79166f301 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:48.756743 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-090b1014-7b9d-4ff4-bc79-16e79166f301 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:48.757177 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-090b1014-7b9d-4ff4-bc79-16e79166f301 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:48.883684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6dce5c14-3639-4206-ba3c-a4bf67fd9da4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:48.884372 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6dce5c14-3639-4206-ba3c-a4bf67fd9da4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:48.891150 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6dce5c14-3639-4206-ba3c-a4bf67fd9da4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:48.891895 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6dce5c14-3639-4206-ba3c-a4bf67fd9da4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:48.892695 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6dce5c14-3639-4206-ba3c-a4bf67fd9da4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:48.893165 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6dce5c14-3639-4206-ba3c-a4bf67fd9da4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:48.896760 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-090b1014-7b9d-4ff4-bc79-16e79166f301 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:48.905276 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-090b1014-7b9d-4ff4-bc79-16e79166f301 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1730 microversion: 2.1 time: 0.160858 Aug 03 10:48:48.905893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 323/662] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:48 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:48.926713 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9b3a67b2-64b4-4bd7-bcfb-0929951dbf01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:48.927492 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9b3a67b2-64b4-4bd7-bcfb-0929951dbf01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:48.933537 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:48.935280 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b3a67b2-64b4-4bd7-bcfb-0929951dbf01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:48.935979 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b3a67b2-64b4-4bd7-bcfb-0929951dbf01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:48.937054 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b3a67b2-64b4-4bd7-bcfb-0929951dbf01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:48.937718 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b3a67b2-64b4-4bd7-bcfb-0929951dbf01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:49.041663 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9b3a67b2-64b4-4bd7-bcfb-0929951dbf01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118632 Aug 03 10:48:49.042291 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 324/663] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 3 10:48:48 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:48:49.048563 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2613d1f9-4117-40ee-9551-457a3ecf6bb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:49.049170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2613d1f9-4117-40ee-9551-457a3ecf6bb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:49.056116 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2613d1f9-4117-40ee-9551-457a3ecf6bb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:49.056576 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2613d1f9-4117-40ee-9551-457a3ecf6bb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:49.057351 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2613d1f9-4117-40ee-9551-457a3ecf6bb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:49.057987 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2613d1f9-4117-40ee-9551-457a3ecf6bb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:49.081046 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6dce5c14-3639-4206-ba3c-a4bf67fd9da4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:49.089874 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6dce5c14-3639-4206-ba3c-a4bf67fd9da4 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1360 microversion: 2.1 time: 0.210067 Aug 03 10:48:49.090548 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 340/664] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:48 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1360 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:48:49.194142 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2613d1f9-4117-40ee-9551-457a3ecf6bb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:49.202544 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2613d1f9-4117-40ee-9551-457a3ecf6bb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:49.204374 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2613d1f9-4117-40ee-9551-457a3ecf6bb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:49.205638 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2613d1f9-4117-40ee-9551-457a3ecf6bb4 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1405 microversion: 2.20 time: 0.160953 Aug 03 10:48:49.206236 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 325/665] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:49 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:50.112141 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:50.174781 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4a37c93a-10da-4552-9f00-2c6c564739d5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:50.175521 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4a37c93a-10da-4552-9f00-2c6c564739d5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:50.181915 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4a37c93a-10da-4552-9f00-2c6c564739d5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:50.182435 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4a37c93a-10da-4552-9f00-2c6c564739d5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:50.183377 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4a37c93a-10da-4552-9f00-2c6c564739d5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:50.183874 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4a37c93a-10da-4552-9f00-2c6c564739d5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:50.235392 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4d108112-831b-45a1-a0ac-3921432ed66d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:50.236260 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4d108112-831b-45a1-a0ac-3921432ed66d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:50.238633 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:50.239896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=12 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:50.247777 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4d108112-831b-45a1-a0ac-3921432ed66d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:50.248870 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4d108112-831b-45a1-a0ac-3921432ed66d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:50.250158 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4d108112-831b-45a1-a0ac-3921432ed66d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:50.250918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4d108112-831b-45a1-a0ac-3921432ed66d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:50.405850 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4a37c93a-10da-4552-9f00-2c6c564739d5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:50.413841 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4a37c93a-10da-4552-9f00-2c6c564739d5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1360 microversion: 2.1 time: 0.306305 Aug 03 10:48:50.414901 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 341/666] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:50 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1360 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:50.419623 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-379de4c9-b3cb-4049-9b8c-6b8ec6d86ea0 req-842cc37e-03cd-4d01-8e9b-c54046de5136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b0240d-3638-48b2-a7f3-2269dd2aba05", "tag": "3a081129-4296-482f-9f57-79ce242de7a4"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:50.429847 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-379de4c9-b3cb-4049-9b8c-6b8ec6d86ea0 req-842cc37e-03cd-4d01-8e9b-c54046de5136 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:50.430582 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-379de4c9-b3cb-4049-9b8c-6b8ec6d86ea0 req-842cc37e-03cd-4d01-8e9b-c54046de5136 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:50.434820 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4d108112-831b-45a1-a0ac-3921432ed66d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:50.445319 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4d108112-831b-45a1-a0ac-3921432ed66d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:50.446894 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4d108112-831b-45a1-a0ac-3921432ed66d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:50.448148 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-4d108112-831b-45a1-a0ac-3921432ed66d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1405 microversion: 2.20 time: 0.217162 Aug 03 10:48:50.448707 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 326/667] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:50 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:50.450052 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-379de4c9-b3cb-4049-9b8c-6b8ec6d86ea0 req-842cc37e-03cd-4d01-8e9b-c54046de5136 service nova] Creating event network-changed:3a081129-4296-482f-9f57-79ce242de7a4 for instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 on hv-cinder-85083 Aug 03 10:48:50.456035 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-379de4c9-b3cb-4049-9b8c-6b8ec6d86ea0 req-842cc37e-03cd-4d01-8e9b-c54046de5136 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039732 Aug 03 10:48:50.456852 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 342/668] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:50.720103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d488e2d5-6c06-43a2-afdd-f7b998e3a944 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:50.720596 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d488e2d5-6c06-43a2-afdd-f7b998e3a944 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:50.726696 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d488e2d5-6c06-43a2-afdd-f7b998e3a944 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:50.727146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d488e2d5-6c06-43a2-afdd-f7b998e3a944 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:50.727930 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d488e2d5-6c06-43a2-afdd-f7b998e3a944 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:50.728357 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d488e2d5-6c06-43a2-afdd-f7b998e3a944 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:50.753170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d488e2d5-6c06-43a2-afdd-f7b998e3a944 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455/ips" status: 200 len: 149 microversion: 2.1 time: 0.036807 Aug 03 10:48:50.754038 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 327/669] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 3 10:48:50 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:51.436985 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2cfd68c9-240f-423b-afa8-470a75cf3fe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:51.437724 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2cfd68c9-240f-423b-afa8-470a75cf3fe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:51.440013 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=12 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:51.447716 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2cfd68c9-240f-423b-afa8-470a75cf3fe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:51.448175 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2cfd68c9-240f-423b-afa8-470a75cf3fe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:51.448972 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2cfd68c9-240f-423b-afa8-470a75cf3fe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:51.449426 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2cfd68c9-240f-423b-afa8-470a75cf3fe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:51.478323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c72329d6-bf08-4bdf-8577-d3d30db96415 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:51.479351 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-c72329d6-bf08-4bdf-8577-d3d30db96415 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:51.516013 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c72329d6-bf08-4bdf-8577-d3d30db96415 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:51.517560 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c72329d6-bf08-4bdf-8577-d3d30db96415 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:51.518969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c72329d6-bf08-4bdf-8577-d3d30db96415 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:51.520048 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c72329d6-bf08-4bdf-8577-d3d30db96415 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:51.676556 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2cfd68c9-240f-423b-afa8-470a75cf3fe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:51.690606 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2cfd68c9-240f-423b-afa8-470a75cf3fe0 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1360 microversion: 2.1 time: 0.258405 Aug 03 10:48:51.691201 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 343/670] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:51 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1360 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:51.714733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c72329d6-bf08-4bdf-8577-d3d30db96415 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:51.723362 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c72329d6-bf08-4bdf-8577-d3d30db96415 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:51.724875 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c72329d6-bf08-4bdf-8577-d3d30db96415 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:51.726570 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c72329d6-bf08-4bdf-8577-d3d30db96415 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1405 microversion: 2.20 time: 0.253413 Aug 03 10:48:51.727139 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 328/671] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:51 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1405 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:48:52.158034 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-38009f43-5e8a-439d-93bd-969d8b4e2731 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef4324d2-9d7d-48e7-8a46-f1aa479d3d44"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:52.160412 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-38009f43-5e8a-439d-93bd-969d8b4e2731 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:52.166689 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-38009f43-5e8a-439d-93bd-969d8b4e2731 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:52.167326 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-38009f43-5e8a-439d-93bd-969d8b4e2731 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:52.168639 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-38009f43-5e8a-439d-93bd-969d8b4e2731 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:52.169735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-38009f43-5e8a-439d-93bd-969d8b4e2731 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:52.415941 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-38009f43-5e8a-439d-93bd-969d8b4e2731 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "POST /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262032 Aug 03 10:48:52.416558 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 344/672] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 3 10:48:52 2022] POST /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:52.470800 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-0e4f6961-c6b5-4c10-8874-2abb2bdd1fd0 req-ff185c3e-dac1-4158-9263-9eeaa4f8d114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b0240d-3638-48b2-a7f3-2269dd2aba05", "tag": "3a081129-4296-482f-9f57-79ce242de7a4"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:52.481707 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-0e4f6961-c6b5-4c10-8874-2abb2bdd1fd0 req-ff185c3e-dac1-4158-9263-9eeaa4f8d114 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:52.482344 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-0e4f6961-c6b5-4c10-8874-2abb2bdd1fd0 req-ff185c3e-dac1-4158-9263-9eeaa4f8d114 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:52.496533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-0e4f6961-c6b5-4c10-8874-2abb2bdd1fd0 req-ff185c3e-dac1-4158-9263-9eeaa4f8d114 service nova] Creating event network-changed:3a081129-4296-482f-9f57-79ce242de7a4 for instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 on hv-cinder-85083 Aug 03 10:48:52.501699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-0e4f6961-c6b5-4c10-8874-2abb2bdd1fd0 req-ff185c3e-dac1-4158-9263-9eeaa4f8d114 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034626 Aug 03 10:48:52.502305 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 329/673] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:48:52.719392 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1c225cde-2e08-4a88-be64-dc396ec1f448 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:52.720097 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1c225cde-2e08-4a88-be64-dc396ec1f448 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:52.727000 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1c225cde-2e08-4a88-be64-dc396ec1f448 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:52.727455 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1c225cde-2e08-4a88-be64-dc396ec1f448 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:52.728224 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1c225cde-2e08-4a88-be64-dc396ec1f448 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:52.728657 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1c225cde-2e08-4a88-be64-dc396ec1f448 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:52.751017 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a7515e3d-c80a-425f-bbe3-65c122fc76eb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:52.751963 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-a7515e3d-c80a-425f-bbe3-65c122fc76eb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:52.759121 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a7515e3d-c80a-425f-bbe3-65c122fc76eb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:52.759564 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a7515e3d-c80a-425f-bbe3-65c122fc76eb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:52.760335 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a7515e3d-c80a-425f-bbe3-65c122fc76eb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:52.760767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a7515e3d-c80a-425f-bbe3-65c122fc76eb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:52.924651 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1c225cde-2e08-4a88-be64-dc396ec1f448 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:52.929292 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:48:52.934647 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1c225cde-2e08-4a88-be64-dc396ec1f448 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1360 microversion: 2.1 time: 0.219923 Aug 03 10:48:52.935227 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 345/674] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:52 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1360 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:52.938852 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-a7515e3d-c80a-425f-bbe3-65c122fc76eb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:52.946796 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-a7515e3d-c80a-425f-bbe3-65c122fc76eb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:52.948295 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-a7515e3d-c80a-425f-bbe3-65c122fc76eb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:52.949403 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-a7515e3d-c80a-425f-bbe3-65c122fc76eb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1405 microversion: 2.20 time: 0.203152 Aug 03 10:48:52.949992 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 330/675] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:52 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:48:53.956142 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4f2777cb-70e4-4a99-935f-96df01a8a2d3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:53.956765 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4f2777cb-70e4-4a99-935f-96df01a8a2d3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:53.964355 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f2777cb-70e4-4a99-935f-96df01a8a2d3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:53.964835 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f2777cb-70e4-4a99-935f-96df01a8a2d3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:53.965659 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f2777cb-70e4-4a99-935f-96df01a8a2d3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:53.966102 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f2777cb-70e4-4a99-935f-96df01a8a2d3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:53.972423 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-daa73fd9-cba5-4417-a027-69311e24c28e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:53.973107 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-daa73fd9-cba5-4417-a027-69311e24c28e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:53.979901 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-daa73fd9-cba5-4417-a027-69311e24c28e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:53.980348 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-daa73fd9-cba5-4417-a027-69311e24c28e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:53.981153 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-daa73fd9-cba5-4417-a027-69311e24c28e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:53.981611 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-daa73fd9-cba5-4417-a027-69311e24c28e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:54.163468 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4f2777cb-70e4-4a99-935f-96df01a8a2d3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:54.167312 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-daa73fd9-cba5-4417-a027-69311e24c28e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:54.171417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4f2777cb-70e4-4a99-935f-96df01a8a2d3 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1360 microversion: 2.1 time: 0.219473 Aug 03 10:48:54.171991 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 346/676] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:53 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1360 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:54.175169 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-daa73fd9-cba5-4417-a027-69311e24c28e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:54.176658 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-daa73fd9-cba5-4417-a027-69311e24c28e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:54.177775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-daa73fd9-cba5-4417-a027-69311e24c28e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1405 microversion: 2.20 time: 0.209216 Aug 03 10:48:54.178321 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 331/677] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:53 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:48:55.193924 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9963f7e4-5c7f-4f03-9d8a-daa6214d04d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:55.195303 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9963f7e4-5c7f-4f03-9d8a-daa6214d04d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:55.202261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-7a45ccee-6ab6-401d-8a2c-6757222060d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:55.203058 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-7a45ccee-6ab6-401d-8a2c-6757222060d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:55.205525 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9963f7e4-5c7f-4f03-9d8a-daa6214d04d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:55.206825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9963f7e4-5c7f-4f03-9d8a-daa6214d04d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:55.208435 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9963f7e4-5c7f-4f03-9d8a-daa6214d04d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:55.209035 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9963f7e4-5c7f-4f03-9d8a-daa6214d04d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:55.218818 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7a45ccee-6ab6-401d-8a2c-6757222060d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:55.219630 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7a45ccee-6ab6-401d-8a2c-6757222060d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:55.221983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7a45ccee-6ab6-401d-8a2c-6757222060d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:55.222533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7a45ccee-6ab6-401d-8a2c-6757222060d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:55.450009 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9963f7e4-5c7f-4f03-9d8a-daa6214d04d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:55.466925 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9963f7e4-5c7f-4f03-9d8a-daa6214d04d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1360 microversion: 2.1 time: 0.276521 Aug 03 10:48:55.467681 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 347/678] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:55 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1360 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:55.481895 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7a45ccee-6ab6-401d-8a2c-6757222060d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:55.492038 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7a45ccee-6ab6-401d-8a2c-6757222060d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:55.493983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7a45ccee-6ab6-401d-8a2c-6757222060d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:55.495110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-7a45ccee-6ab6-401d-8a2c-6757222060d0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1405 microversion: 2.20 time: 0.298494 Aug 03 10:48:55.500423 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 332/679] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:55 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1405 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:56.488408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-41d6d435-c5fd-43f9-ac51-910f2dcf1b10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:56.489022 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-41d6d435-c5fd-43f9-ac51-910f2dcf1b10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:56.496081 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41d6d435-c5fd-43f9-ac51-910f2dcf1b10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:56.496531 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41d6d435-c5fd-43f9-ac51-910f2dcf1b10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:56.497393 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41d6d435-c5fd-43f9-ac51-910f2dcf1b10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:56.497925 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41d6d435-c5fd-43f9-ac51-910f2dcf1b10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:56.523261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-918dabee-38d8-4c47-a34c-f9dd3ffca6e6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:56.524946 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-918dabee-38d8-4c47-a34c-f9dd3ffca6e6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:56.532448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-918dabee-38d8-4c47-a34c-f9dd3ffca6e6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:56.533141 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-918dabee-38d8-4c47-a34c-f9dd3ffca6e6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:56.534271 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-918dabee-38d8-4c47-a34c-f9dd3ffca6e6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:56.534856 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-918dabee-38d8-4c47-a34c-f9dd3ffca6e6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:56.727811 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-41d6d435-c5fd-43f9-ac51-910f2dcf1b10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:56.737202 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-41d6d435-c5fd-43f9-ac51-910f2dcf1b10 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1360 microversion: 2.1 time: 0.252735 Aug 03 10:48:56.738101 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 348/680] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:56 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1360 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:56.754973 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-918dabee-38d8-4c47-a34c-f9dd3ffca6e6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:56.764776 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-918dabee-38d8-4c47-a34c-f9dd3ffca6e6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:56.766353 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-918dabee-38d8-4c47-a34c-f9dd3ffca6e6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:56.767493 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-918dabee-38d8-4c47-a34c-f9dd3ffca6e6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1405 microversion: 2.20 time: 0.253830 Aug 03 10:48:56.768052 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 333/681] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:56 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1405 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:57.292164 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-45beacfb-ddd7-4fe7-926e-ecc614abda60 req-db7a4317-c88e-444f-bded-91fa8288b931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310651c9-a8fa-4169-950a-581cfdedf786", "name": "network-vif-plugged", "status": "completed", "tag": "dade6b18-ba20-4633-971b-0a3be895b570"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:57.302233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-45beacfb-ddd7-4fe7-926e-ecc614abda60 req-db7a4317-c88e-444f-bded-91fa8288b931 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:57.302672 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-45beacfb-ddd7-4fe7-926e-ecc614abda60 req-db7a4317-c88e-444f-bded-91fa8288b931 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:57.315316 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-45beacfb-ddd7-4fe7-926e-ecc614abda60 req-db7a4317-c88e-444f-bded-91fa8288b931 service nova] Creating event network-vif-plugged:dade6b18-ba20-4633-971b-0a3be895b570 for instance 310651c9-a8fa-4169-950a-581cfdedf786 on hv-cinder-85083 Aug 03 10:48:57.320879 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-45beacfb-ddd7-4fe7-926e-ecc614abda60 req-db7a4317-c88e-444f-bded-91fa8288b931 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032463 Aug 03 10:48:57.321512 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 349/682] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:57.760530 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-fed51f1d-3f37-46e2-978c-e00202e92adc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:57.761493 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-fed51f1d-3f37-46e2-978c-e00202e92adc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:57.769092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fed51f1d-3f37-46e2-978c-e00202e92adc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:57.769701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fed51f1d-3f37-46e2-978c-e00202e92adc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:57.770477 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fed51f1d-3f37-46e2-978c-e00202e92adc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:57.770929 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fed51f1d-3f37-46e2-978c-e00202e92adc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:57.802810 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-92433c84-b09d-4206-9fbc-b743275ccf98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:57.803813 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-92433c84-b09d-4206-9fbc-b743275ccf98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:57.811813 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-92433c84-b09d-4206-9fbc-b743275ccf98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:57.812344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-92433c84-b09d-4206-9fbc-b743275ccf98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:57.813211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-92433c84-b09d-4206-9fbc-b743275ccf98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:57.813740 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-92433c84-b09d-4206-9fbc-b743275ccf98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:58.203666 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-fed51f1d-3f37-46e2-978c-e00202e92adc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:58.217049 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-fed51f1d-3f37-46e2-978c-e00202e92adc tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1360 microversion: 2.1 time: 0.459836 Aug 03 10:48:58.218218 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 334/683] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:57 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1360 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:58.230790 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-92433c84-b09d-4206-9fbc-b743275ccf98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:58.241955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-92433c84-b09d-4206-9fbc-b743275ccf98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:58.243455 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-92433c84-b09d-4206-9fbc-b743275ccf98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:58.244569 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-92433c84-b09d-4206-9fbc-b743275ccf98 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1405 microversion: 2.20 time: 0.446715 Aug 03 10:48:58.245132 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 350/684] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:57 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:48:59.240464 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d08d6d25-f08e-4c06-b29c-848d61dc8c94 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:59.241083 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d08d6d25-f08e-4c06-b29c-848d61dc8c94 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:59.248236 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d08d6d25-f08e-4c06-b29c-848d61dc8c94 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:59.248688 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d08d6d25-f08e-4c06-b29c-848d61dc8c94 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:59.249512 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d08d6d25-f08e-4c06-b29c-848d61dc8c94 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:59.249917 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d08d6d25-f08e-4c06-b29c-848d61dc8c94 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:59.267629 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-07a267d6-7255-4a7c-a62f-5b145f0926e1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:59.268230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-07a267d6-7255-4a7c-a62f-5b145f0926e1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:59.275125 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-07a267d6-7255-4a7c-a62f-5b145f0926e1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:59.275575 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-07a267d6-7255-4a7c-a62f-5b145f0926e1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:59.276376 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-07a267d6-7255-4a7c-a62f-5b145f0926e1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:59.276816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-07a267d6-7255-4a7c-a62f-5b145f0926e1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:59.464671 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d08d6d25-f08e-4c06-b29c-848d61dc8c94 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:59.472409 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-07a267d6-7255-4a7c-a62f-5b145f0926e1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:59.472612 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d08d6d25-f08e-4c06-b29c-848d61dc8c94 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1546 microversion: 2.1 time: 0.236211 Aug 03 10:48:59.473254 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 335/685] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:48:59 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1546 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:48:59.478394 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-86f54845-4bdc-48e1-8564-524b83025492 req-9d91abac-59c7-4348-b78a-aa9e2ff717b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cbe8d4-0681-4b94-a774-1f0067f69263", "name": "network-vif-plugged", "status": "completed", "tag": "5c7bb60f-6fc3-4d3d-bda1-d77d9a5e91fb"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:48:59.482571 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-07a267d6-7255-4a7c-a62f-5b145f0926e1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:59.484388 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-07a267d6-7255-4a7c-a62f-5b145f0926e1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:48:59.485624 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-07a267d6-7255-4a7c-a62f-5b145f0926e1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1405 microversion: 2.20 time: 0.221867 Aug 03 10:48:59.486874 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 351/686] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:48:59 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:48:59.493934 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-86f54845-4bdc-48e1-8564-524b83025492 req-9d91abac-59c7-4348-b78a-aa9e2ff717b9 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:59.494560 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-86f54845-4bdc-48e1-8564-524b83025492 req-9d91abac-59c7-4348-b78a-aa9e2ff717b9 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:59.497489 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-56333270-d16c-4ae0-b7da-ee9f9793c3c7 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:48:59.498451 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-56333270-d16c-4ae0-b7da-ee9f9793c3c7 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:48:59.509412 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-86f54845-4bdc-48e1-8564-524b83025492 req-9d91abac-59c7-4348-b78a-aa9e2ff717b9 service nova] Creating event network-vif-plugged:5c7bb60f-6fc3-4d3d-bda1-d77d9a5e91fb for instance 99cbe8d4-0681-4b94-a774-1f0067f69263 on hv-cinder-85083 Aug 03 10:48:59.510281 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-56333270-d16c-4ae0-b7da-ee9f9793c3c7 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:59.511079 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-56333270-d16c-4ae0-b7da-ee9f9793c3c7 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:59.512477 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-56333270-d16c-4ae0-b7da-ee9f9793c3c7 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:48:59.513272 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-56333270-d16c-4ae0-b7da-ee9f9793c3c7 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:48:59.514504 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-86f54845-4bdc-48e1-8564-524b83025492 req-9d91abac-59c7-4348-b78a-aa9e2ff717b9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040133 Aug 03 10:48:59.515320 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 336/687] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:48:59.608323 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-56333270-d16c-4ae0-b7da-ee9f9793c3c7 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117501 Aug 03 10:48:59.615742 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 352/688] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 3 10:48:59 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:49:00.511943 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-150a39e9-f54e-4087-9162-84d4dcb07772 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:00.512652 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-150a39e9-f54e-4087-9162-84d4dcb07772 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:00.519235 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-150a39e9-f54e-4087-9162-84d4dcb07772 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:00.519678 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-150a39e9-f54e-4087-9162-84d4dcb07772 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:00.520442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-150a39e9-f54e-4087-9162-84d4dcb07772 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:00.520875 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-150a39e9-f54e-4087-9162-84d4dcb07772 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:00.658696 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-46ce34e2-68ca-4b98-86d9-29544d70d61d req-208299ad-c77d-4a66-a3a9-7b6e4e135ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "310651c9-a8fa-4169-950a-581cfdedf786", "tag": "dade6b18-ba20-4633-971b-0a3be895b570"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:00.669172 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-46ce34e2-68ca-4b98-86d9-29544d70d61d req-208299ad-c77d-4a66-a3a9-7b6e4e135ac4 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:00.669905 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-46ce34e2-68ca-4b98-86d9-29544d70d61d req-208299ad-c77d-4a66-a3a9-7b6e4e135ac4 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:00.690539 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-46ce34e2-68ca-4b98-86d9-29544d70d61d req-208299ad-c77d-4a66-a3a9-7b6e4e135ac4 service nova] Creating event network-changed:dade6b18-ba20-4633-971b-0a3be895b570 for instance 310651c9-a8fa-4169-950a-581cfdedf786 on hv-cinder-85083 Aug 03 10:49:00.699737 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-46ce34e2-68ca-4b98-86d9-29544d70d61d req-208299ad-c77d-4a66-a3a9-7b6e4e135ac4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044581 Aug 03 10:49:00.699949 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-150a39e9-f54e-4087-9162-84d4dcb07772 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:00.700158 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 353/689] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:49:00.709411 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-150a39e9-f54e-4087-9162-84d4dcb07772 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:00.711206 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-150a39e9-f54e-4087-9162-84d4dcb07772 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:00.712280 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-150a39e9-f54e-4087-9162-84d4dcb07772 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1405 microversion: 2.20 time: 0.206488 Aug 03 10:49:00.713405 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 337/690] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:49:00 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:49:01.736329 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f0065b85-d667-4cad-88bd-b299f1155bb3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:01.737035 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f0065b85-d667-4cad-88bd-b299f1155bb3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:01.744536 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f0065b85-d667-4cad-88bd-b299f1155bb3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:01.744988 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f0065b85-d667-4cad-88bd-b299f1155bb3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:01.745798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f0065b85-d667-4cad-88bd-b299f1155bb3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:01.746235 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f0065b85-d667-4cad-88bd-b299f1155bb3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:01.931731 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f0065b85-d667-4cad-88bd-b299f1155bb3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:01.942088 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f0065b85-d667-4cad-88bd-b299f1155bb3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:01.944057 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f0065b85-d667-4cad-88bd-b299f1155bb3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:01.946111 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f0065b85-d667-4cad-88bd-b299f1155bb3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1597 microversion: 2.20 time: 0.214038 Aug 03 10:49:01.947240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 354/691] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:49:01 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1597 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:49:01.969239 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3d1767ce-5dcb-45cb-b54a-71ec0400e0d7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:01.969838 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3d1767ce-5dcb-45cb-b54a-71ec0400e0d7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:01.976733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3d1767ce-5dcb-45cb-b54a-71ec0400e0d7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:01.981478 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3d1767ce-5dcb-45cb-b54a-71ec0400e0d7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:01.981478 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3d1767ce-5dcb-45cb-b54a-71ec0400e0d7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:01.981478 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3d1767ce-5dcb-45cb-b54a-71ec0400e0d7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:02.067824 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3d1767ce-5dcb-45cb-b54a-71ec0400e0d7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102281 Aug 03 10:49:02.068740 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 338/692] 10.222.0.47 () {60 vars in 1316 bytes} [Wed Aug 3 10:49:01 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:49:03.192407 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-30419544-812c-4f89-8b09-785011ce5950 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef4324d2-9d7d-48e7-8a46-f1aa479d3d44"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:03.196297 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-30419544-812c-4f89-8b09-785011ce5950 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:03.204921 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-30419544-812c-4f89-8b09-785011ce5950 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:03.205720 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-30419544-812c-4f89-8b09-785011ce5950 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:03.206977 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-30419544-812c-4f89-8b09-785011ce5950 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:03.207583 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-30419544-812c-4f89-8b09-785011ce5950 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:03.304912 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-30419544-812c-4f89-8b09-785011ce5950 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] HTTP exception thrown: Invalid volume: volume ef4324d2-9d7d-48e7-8a46-f1aa479d3d44 is already attached to instances: 848ceec4-9b34-4e0f-a57e-95de02097455 Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-30419544-812c-4f89-8b09-785011ce5950 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Request method failure captured: Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: POST /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455/os-volume_attachments HTTP/1.1 Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 74 Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFpofOqKz5CBf-8MdepxWHeAf9pqHZ8ygUVMa40UQbmj6S4Pciia3iBGqdVVK2sWWb-uohBfvQN9NFiLpHXqxqcuFtxzwWGZSpwMcdozNESD7s6BjUOpefCniYDb7sEM8Bcsphf4xva9kPBkQalQSLDW-EAJxbqQOqGbR6FCdDQnOg Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:49:03.306675 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:49:03.309735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/40540f8322a54133bc32e1af000810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_40540f8322a54133bc32e1af000810ad", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:49:03.309735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:49:03.309735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:49:03.309735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:49:03.309735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:49:03.309735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:49:03.309735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:49:03.309735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 956aff831fa04d29ba5cffb88e73f4d2 Aug 03 10:49:03.309735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:49:03.309735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Aug 03 10:49:03.309735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {"volumeAttachment": {"volumeId": "ef4324d2-9d7d-48e7-8a46-f1aa479d3d44"}} Aug 03 10:49:03.309735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Invalid volume: volume ef4324d2-9d7d-48e7-8a46-f1aa479d3d44 is already attached to instances: 848ceec4-9b34-4e0f-a57e-95de02097455 Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'server_id': '848ceec4-9b34-4e0f-a57e-95de02097455', 'body': {'volumeAttachment': {'volumeId': 'ef4324d2-9d7d-48e7-8a46-f1aa479d3d44'}}} Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ef4324d2-9d7d-48e7-8a46-f1aa479d3d44 is already attached to instances: 848ceec4-9b34-4e0f-a57e-95de02097455 Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:49:03.311365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ef4324d2-9d7d-48e7-8a46-f1aa479d3d44 is already attached to instances: 848ceec4-9b34-4e0f-a57e-95de02097455 Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:49:03.314038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:49:03.316380 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:49:03.316380 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:49:03.316380 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:49:03.316380 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ef4324d2-9d7d-48e7-8a46-f1aa479d3d44 is already attached to instances: 848ceec4-9b34-4e0f-a57e-95de02097455 Aug 03 10:49:03.316380 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:49:03.316380 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-30419544-812c-4f89-8b09-785011ce5950 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Returning 400 to user: Invalid volume: volume ef4324d2-9d7d-48e7-8a46-f1aa479d3d44 is already attached to instances: 848ceec4-9b34-4e0f-a57e-95de02097455 {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:49:03.316380 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-30419544-812c-4f89-8b09-785011ce5950 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "POST /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123263 Aug 03 10:49:03.316380 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 355/693] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 3 10:49:03 2022] POST /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455/os-volume_attachments => generated 174 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 10:49:03.391065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-01b70e87-3850-46a3-baf9-5c452d7f5196 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:03.391558 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-01b70e87-3850-46a3-baf9-5c452d7f5196 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:03.397717 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-01b70e87-3850-46a3-baf9-5c452d7f5196 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:03.398693 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-01b70e87-3850-46a3-baf9-5c452d7f5196 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:03.398951 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-01b70e87-3850-46a3-baf9-5c452d7f5196 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:03.399397 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-01b70e87-3850-46a3-baf9-5c452d7f5196 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:03.405492 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=100 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:49:03.487148 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-01b70e87-3850-46a3-baf9-5c452d7f5196 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lazy-loading 'services' on Instance uuid 848ceec4-9b34-4e0f-a57e-95de02097455 {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:49:03.577429 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-2b63a48b-9f0b-4ca5-b31c-030a80bb127a req-c9d11bf8-4530-4aa3-bcae-1996c92e1a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99cbe8d4-0681-4b94-a774-1f0067f69263", "tag": "5c7bb60f-6fc3-4d3d-bda1-d77d9a5e91fb"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:03.602124 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-2b63a48b-9f0b-4ca5-b31c-030a80bb127a req-c9d11bf8-4530-4aa3-bcae-1996c92e1a38 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:03.602909 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-2b63a48b-9f0b-4ca5-b31c-030a80bb127a req-c9d11bf8-4530-4aa3-bcae-1996c92e1a38 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:03.603135 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-01b70e87-3850-46a3-baf9-5c452d7f5196 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "DELETE /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455/os-volume_attachments/ef4324d2-9d7d-48e7-8a46-f1aa479d3d44" status: 202 len: 0 microversion: 2.1 time: 0.215788 Aug 03 10:49:03.609950 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 339/694] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 3 10:49:03 2022] DELETE /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455/os-volume_attachments/ef4324d2-9d7d-48e7-8a46-f1aa479d3d44 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:49:03.634086 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-2b63a48b-9f0b-4ca5-b31c-030a80bb127a req-c9d11bf8-4530-4aa3-bcae-1996c92e1a38 service nova] Creating event network-changed:5c7bb60f-6fc3-4d3d-bda1-d77d9a5e91fb for instance 99cbe8d4-0681-4b94-a774-1f0067f69263 on hv-cinder-85083 Aug 03 10:49:03.637364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-df4c7f62-56b1-4a95-a27b-020f5de156d3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:03.644497 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-df4c7f62-56b1-4a95-a27b-020f5de156d3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:03.659747 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-2b63a48b-9f0b-4ca5-b31c-030a80bb127a req-c9d11bf8-4530-4aa3-bcae-1996c92e1a38 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090359 Aug 03 10:49:03.661669 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 356/695] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:49:03.670187 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-df4c7f62-56b1-4a95-a27b-020f5de156d3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:03.670849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-df4c7f62-56b1-4a95-a27b-020f5de156d3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:03.671813 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-df4c7f62-56b1-4a95-a27b-020f5de156d3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:03.673066 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-df4c7f62-56b1-4a95-a27b-020f5de156d3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:03.719839 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-df4c7f62-56b1-4a95-a27b-020f5de156d3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107979 Aug 03 10:49:03.720559 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 340/696] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:49:03 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:49:04.734109 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ae1db58b-548b-4855-b798-5e4b8ddd4a24 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:04.736406 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ae1db58b-548b-4855-b798-5e4b8ddd4a24 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:04.743760 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae1db58b-548b-4855-b798-5e4b8ddd4a24 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:04.744192 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae1db58b-548b-4855-b798-5e4b8ddd4a24 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:04.744987 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae1db58b-548b-4855-b798-5e4b8ddd4a24 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:04.745425 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae1db58b-548b-4855-b798-5e4b8ddd4a24 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:04.778439 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ae1db58b-548b-4855-b798-5e4b8ddd4a24 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049389 Aug 03 10:49:04.779250 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 357/697] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:49:04 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 10:49:04.867453 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-397ce3f4-b768-4b48-9afa-40369eeee678 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:04.868359 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-397ce3f4-b768-4b48-9afa-40369eeee678 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:04.879805 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-397ce3f4-b768-4b48-9afa-40369eeee678 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:04.880761 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-397ce3f4-b768-4b48-9afa-40369eeee678 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:04.882803 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-397ce3f4-b768-4b48-9afa-40369eeee678 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:04.884166 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-397ce3f4-b768-4b48-9afa-40369eeee678 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:04.928395 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-397ce3f4-b768-4b48-9afa-40369eeee678 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Going to try to terminate instance {{(pid=124389) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:49:05.015454 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-397ce3f4-b768-4b48-9afa-40369eeee678 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "DELETE /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 204 len: 0 microversion: 2.1 time: 0.155913 Aug 03 10:49:05.016242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 341/698] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:49:04 2022] DELETE /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:49:05.027769 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0b55e680-f645-41a2-9bd5-a85a3658d843 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:05.028382 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0b55e680-f645-41a2-9bd5-a85a3658d843 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:05.042680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b55e680-f645-41a2-9bd5-a85a3658d843 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:05.042908 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b55e680-f645-41a2-9bd5-a85a3658d843 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:05.043919 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b55e680-f645-41a2-9bd5-a85a3658d843 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:05.044191 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b55e680-f645-41a2-9bd5-a85a3658d843 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:05.236762 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0b55e680-f645-41a2-9bd5-a85a3658d843 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:05.245985 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0b55e680-f645-41a2-9bd5-a85a3658d843 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1681 microversion: 2.1 time: 0.224734 Aug 03 10:49:05.246583 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 358/699] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:05 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:06.268366 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-20777315-b091-415d-805e-88119d31ea51 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:06.269215 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-20777315-b091-415d-805e-88119d31ea51 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:06.275924 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-20777315-b091-415d-805e-88119d31ea51 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:06.276462 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-20777315-b091-415d-805e-88119d31ea51 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:06.277254 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-20777315-b091-415d-805e-88119d31ea51 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:06.277713 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-20777315-b091-415d-805e-88119d31ea51 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:06.436901 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-20777315-b091-415d-805e-88119d31ea51 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:06.446452 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-20777315-b091-415d-805e-88119d31ea51 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1681 microversion: 2.1 time: 0.182388 Aug 03 10:49:06.454019 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 342/700] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:06 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:07.470121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-53c3b950-e6e4-4ff8-8995-fc7d87f41fe7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:07.470756 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-53c3b950-e6e4-4ff8-8995-fc7d87f41fe7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:07.479065 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53c3b950-e6e4-4ff8-8995-fc7d87f41fe7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:07.479882 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53c3b950-e6e4-4ff8-8995-fc7d87f41fe7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:07.480912 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53c3b950-e6e4-4ff8-8995-fc7d87f41fe7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:07.481854 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53c3b950-e6e4-4ff8-8995-fc7d87f41fe7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:07.552410 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-53c3b950-e6e4-4ff8-8995-fc7d87f41fe7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:07.566189 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-53c3b950-e6e4-4ff8-8995-fc7d87f41fe7 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 200 len: 1614 microversion: 2.1 time: 0.101114 Aug 03 10:49:07.567067 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 359/701] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:07 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 1614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:07.720470 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-2812ba8a-90d4-4bfc-9c75-42ce1b5da437 req-ae3016ef-5552-469d-b564-4e8942ff6e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "848ceec4-9b34-4e0f-a57e-95de02097455", "name": "network-vif-deleted", "tag": "9cba26e5-f3cf-4c00-8b87-69db9302e407"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:07.746874 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-2812ba8a-90d4-4bfc-9c75-42ce1b5da437 req-ae3016ef-5552-469d-b564-4e8942ff6e40 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:07.747668 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-2812ba8a-90d4-4bfc-9c75-42ce1b5da437 req-ae3016ef-5552-469d-b564-4e8942ff6e40 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:07.764832 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-2812ba8a-90d4-4bfc-9c75-42ce1b5da437 req-ae3016ef-5552-469d-b564-4e8942ff6e40 service nova] Creating event network-vif-deleted:9cba26e5-f3cf-4c00-8b87-69db9302e407 for instance 848ceec4-9b34-4e0f-a57e-95de02097455 on hv-cinder-85083 Aug 03 10:49:07.772798 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-2812ba8a-90d4-4bfc-9c75-42ce1b5da437 req-ae3016ef-5552-469d-b564-4e8942ff6e40 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060815 Aug 03 10:49:07.774722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 343/702] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:49:08.591696 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e8e32c82-c92f-436a-acb7-ce5cc62f17cf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:08.592968 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e8e32c82-c92f-436a-acb7-ce5cc62f17cf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:08.603915 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8e32c82-c92f-436a-acb7-ce5cc62f17cf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:08.604643 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8e32c82-c92f-436a-acb7-ce5cc62f17cf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:08.605820 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8e32c82-c92f-436a-acb7-ce5cc62f17cf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:08.606502 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8e32c82-c92f-436a-acb7-ce5cc62f17cf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:08.625561 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-e8e32c82-c92f-436a-acb7-ce5cc62f17cf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] HTTP exception thrown: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e8e32c82-c92f-436a-acb7-ce5cc62f17cf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Request method failure captured: Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 HTTP/1.1 Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFpofOqKz5CBf-8MdepxWHeAf9pqHZ8ygUVMa40UQbmj6S4Pciia3iBGqdVVK2sWWb-uohBfvQN9NFiLpHXqxqcuFtxzwWGZSpwMcdozNESD7s6BjUOpefCniYDb7sEM8Bcsphf4xva9kPBkQalQSLDW-EAJxbqQOqGbR6FCdDQnOg Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:49:08.627417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:49:08.630379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/40540f8322a54133bc32e1af000810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_40540f8322a54133bc32e1af000810ad", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:49:08.630379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:49:08.630379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:49:08.630379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:49:08.630379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:49:08.630379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:49:08.630379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:49:08.630379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 956aff831fa04d29ba5cffb88e73f4d2 Aug 03 10:49:08.630379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:49:08.630379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:49:08.630379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. Aug 03 10:49:08.630379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': '848ceec4-9b34-4e0f-a57e-95de02097455'} Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:49:08.632544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. Aug 03 10:49:08.636091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:49:08.640243 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e8e32c82-c92f-436a-acb7-ce5cc62f17cf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Returning 404 to user: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:49:08.640243 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e8e32c82-c92f-436a-acb7-ce5cc62f17cf tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 404 len: 111 microversion: 2.1 time: 0.044891 Aug 03 10:49:08.640243 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 360/703] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:08 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:49:08.641166 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-24557df1-02df-497d-b44c-7c0083380347 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '.version_select at 0x7fbd1053c1f0>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:08.662288 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-24557df1-02df-497d-b44c-7c0083380347 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1882944244" status: 202 len: 0 microversion: 2.1 time: 0.026966 Aug 03 10:49:08.662956 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 344/704] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Aug 3 10:49:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1882944244 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:49:09.305916 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2bc1141b-dc5a-4f6a-b36d-e5486cd871d6 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Action: 'create', calling method: .version_select at 0x7fbd1061f700>, body: {"keypair": {"name": "tempest-keypair-1999273207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPvgiemcABomDJ+l5btThSKVjek1pWYkLH8Bthcf65KPJGXP2uuJCPRXZw+p4bi6rji7BUWLSYwh9r4NGlOg8wOMmUuOwFeh+wI2V+JHMUmWvwCG9irIEKvVmLR5o8mCw=="}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:09.324186 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-2bc1141b-dc5a-4f6a-b36d-e5486cd871d6 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for project 40540f8322a54133bc32e1af000810ad. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:49:09.330868 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-2bc1141b-dc5a-4f6a-b36d-e5486cd871d6 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for user 956aff831fa04d29ba5cffb88e73f4d2 and project 40540f8322a54133bc32e1af000810ad. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:49:09.354781 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2bc1141b-dc5a-4f6a-b36d-e5486cd871d6 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053320 Aug 03 10:49:09.355395 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 361/705] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 3 10:49:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:49:10.680102 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-459187476", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42fc3d27-55c9-4201-9ee3-9a52a8c6af61"}], "security_groups": [{"name": "tempest-securitygroup--1780736419"}], "key_name": "tempest-keypair-1999273207", "user_data": "}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:10.786053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.network.neutron [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] validate_networks() for [('42fc3d27-55c9-4201-9ee3-9a52a8c6af61', None, None, None, None, None)] {{(pid=124389) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:49:11.257542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Flavor limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:49:11.257971 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Image limits 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:49:11.258445 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Flavor pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:49:11.258852 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Image pref 0:0:0 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:49:11.259266 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.virt.hardware [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:49:11.268186 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:11.268633 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:11.269434 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:11.269905 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:11.286768 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for project 40540f8322a54133bc32e1af000810ad. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:49:11.291224 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Getting quotas for user 956aff831fa04d29ba5cffb88e73f4d2 and project 40540f8322a54133bc32e1af000810ad. Resources: {'cores', 'instances', 'ram'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:49:11.302202 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Going to run 1 instances... {{(pid=124389) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:49:11.305206 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:49:11.354081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-29085ab2-555f-4226-8c48-9add47da6fd0 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.679070 Aug 03 10:49:11.354745 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 345/706] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:49:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 10:49:11.367196 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-987142a4-b997-44b1-b7bb-93241ec83f80 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:11.367905 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-987142a4-b997-44b1-b7bb-93241ec83f80 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:11.370953 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:49:11.427291 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-987142a4-b997-44b1-b7bb-93241ec83f80 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:11.435406 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-987142a4-b997-44b1-b7bb-93241ec83f80 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1241 microversion: 2.1 time: 0.073646 Aug 03 10:49:11.436001 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 362/707] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:11 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:12.462357 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3e287ef7-0520-462d-9c44-22c73741898e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:12.462971 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3e287ef7-0520-462d-9c44-22c73741898e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:12.475022 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3e287ef7-0520-462d-9c44-22c73741898e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:12.475469 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3e287ef7-0520-462d-9c44-22c73741898e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:12.476230 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3e287ef7-0520-462d-9c44-22c73741898e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:12.476665 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3e287ef7-0520-462d-9c44-22c73741898e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:12.537958 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3e287ef7-0520-462d-9c44-22c73741898e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:12.545255 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3e287ef7-0520-462d-9c44-22c73741898e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1245 microversion: 2.1 time: 0.087267 Aug 03 10:49:12.545842 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 346/708] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:12 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:13.571252 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b434a05d-0176-4fa4-8b3f-39c4b2603705 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:13.572787 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b434a05d-0176-4fa4-8b3f-39c4b2603705 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:13.583500 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b434a05d-0176-4fa4-8b3f-39c4b2603705 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:13.584043 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b434a05d-0176-4fa4-8b3f-39c4b2603705 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:13.585087 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b434a05d-0176-4fa4-8b3f-39c4b2603705 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:13.585620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b434a05d-0176-4fa4-8b3f-39c4b2603705 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:13.666321 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b434a05d-0176-4fa4-8b3f-39c4b2603705 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:13.676253 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b434a05d-0176-4fa4-8b3f-39c4b2603705 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1301 microversion: 2.1 time: 0.112579 Aug 03 10:49:13.676834 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 363/709] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:13 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1301 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:14.701371 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b1643641-dd6c-4b1a-b634-00c94cd3d7b5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:14.703554 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b1643641-dd6c-4b1a-b634-00c94cd3d7b5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:14.715646 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b1643641-dd6c-4b1a-b634-00c94cd3d7b5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:14.716446 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b1643641-dd6c-4b1a-b634-00c94cd3d7b5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:14.717884 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b1643641-dd6c-4b1a-b634-00c94cd3d7b5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:14.718688 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b1643641-dd6c-4b1a-b634-00c94cd3d7b5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:14.899665 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b1643641-dd6c-4b1a-b634-00c94cd3d7b5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:14.918809 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b1643641-dd6c-4b1a-b634-00c94cd3d7b5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1367 microversion: 2.1 time: 0.223891 Aug 03 10:49:14.920205 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 347/710] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:14 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:14.959541 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-25315907-f478-4ee8-8d7c-27835f3e90b5 req-e4845e48-0b70-46bb-9cd0-98da3e9dcaa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53cc123d-d9f0-4035-ad45-42ba2f585c90", "tag": "124f697b-af93-48b0-a073-3647bab4089e"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:14.971588 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-25315907-f478-4ee8-8d7c-27835f3e90b5 req-e4845e48-0b70-46bb-9cd0-98da3e9dcaa8 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:14.972362 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-25315907-f478-4ee8-8d7c-27835f3e90b5 req-e4845e48-0b70-46bb-9cd0-98da3e9dcaa8 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:14.984344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-25315907-f478-4ee8-8d7c-27835f3e90b5 req-e4845e48-0b70-46bb-9cd0-98da3e9dcaa8 service nova] Creating event network-changed:124f697b-af93-48b0-a073-3647bab4089e for instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 on hv-cinder-85083 Aug 03 10:49:14.990162 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-25315907-f478-4ee8-8d7c-27835f3e90b5 req-e4845e48-0b70-46bb-9cd0-98da3e9dcaa8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040083 Aug 03 10:49:14.991073 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 364/711] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:49:15.942846 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-994c8bc8-b9e3-4a6c-8b11-01fa04c2f5a1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:15.943465 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-994c8bc8-b9e3-4a6c-8b11-01fa04c2f5a1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:15.950148 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-994c8bc8-b9e3-4a6c-8b11-01fa04c2f5a1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:15.950592 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-994c8bc8-b9e3-4a6c-8b11-01fa04c2f5a1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:15.951359 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-994c8bc8-b9e3-4a6c-8b11-01fa04c2f5a1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:15.951790 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-994c8bc8-b9e3-4a6c-8b11-01fa04c2f5a1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:16.152150 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-994c8bc8-b9e3-4a6c-8b11-01fa04c2f5a1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:16.159756 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-994c8bc8-b9e3-4a6c-8b11-01fa04c2f5a1 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1367 microversion: 2.1 time: 0.221112 Aug 03 10:49:16.160349 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 348/712] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:15 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:17.182856 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2b25448b-d788-4587-8d4e-1e7e88e433bc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:17.183558 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2b25448b-d788-4587-8d4e-1e7e88e433bc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:17.189961 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b25448b-d788-4587-8d4e-1e7e88e433bc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:17.190423 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b25448b-d788-4587-8d4e-1e7e88e433bc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:17.191195 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b25448b-d788-4587-8d4e-1e7e88e433bc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:17.191633 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b25448b-d788-4587-8d4e-1e7e88e433bc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:17.330507 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2b25448b-d788-4587-8d4e-1e7e88e433bc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:17.339189 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2b25448b-d788-4587-8d4e-1e7e88e433bc tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1367 microversion: 2.1 time: 0.161076 Aug 03 10:49:17.339904 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 365/713] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:17 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:18.363460 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9212b111-2c01-4045-80bd-fc52d51e793c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:18.364069 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9212b111-2c01-4045-80bd-fc52d51e793c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:18.371002 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9212b111-2c01-4045-80bd-fc52d51e793c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:18.371452 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9212b111-2c01-4045-80bd-fc52d51e793c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:18.372212 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9212b111-2c01-4045-80bd-fc52d51e793c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:18.372646 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9212b111-2c01-4045-80bd-fc52d51e793c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:18.507234 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9212b111-2c01-4045-80bd-fc52d51e793c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:18.515486 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9212b111-2c01-4045-80bd-fc52d51e793c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1367 microversion: 2.1 time: 0.156093 Aug 03 10:49:18.516058 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 349/714] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:18 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:49:19.536105 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-eea4734b-9195-4d7d-a698-e0d8c207dbb8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:19.536764 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-eea4734b-9195-4d7d-a698-e0d8c207dbb8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:19.544517 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eea4734b-9195-4d7d-a698-e0d8c207dbb8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:19.544968 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eea4734b-9195-4d7d-a698-e0d8c207dbb8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:19.545789 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eea4734b-9195-4d7d-a698-e0d8c207dbb8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:19.546229 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eea4734b-9195-4d7d-a698-e0d8c207dbb8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:19.695834 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-eea4734b-9195-4d7d-a698-e0d8c207dbb8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:19.705225 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-eea4734b-9195-4d7d-a698-e0d8c207dbb8 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1367 microversion: 2.1 time: 0.172974 Aug 03 10:49:19.705883 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 366/715] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:19 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:49:20.728917 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-10eafdb4-e9e2-4d4a-8c50-169fdecc7c99 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:20.729562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-10eafdb4-e9e2-4d4a-8c50-169fdecc7c99 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:20.732943 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:49:20.740755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-10eafdb4-e9e2-4d4a-8c50-169fdecc7c99 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:20.741254 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-10eafdb4-e9e2-4d4a-8c50-169fdecc7c99 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:20.742580 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-10eafdb4-e9e2-4d4a-8c50-169fdecc7c99 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:20.743044 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-10eafdb4-e9e2-4d4a-8c50-169fdecc7c99 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:20.892068 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-10eafdb4-e9e2-4d4a-8c50-169fdecc7c99 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:20.900874 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-10eafdb4-e9e2-4d4a-8c50-169fdecc7c99 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1367 microversion: 2.1 time: 0.177962 Aug 03 10:49:20.901558 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 350/716] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:20 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:21.202709 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ff109494-c9d8-4a46-98b0-9f8c053d7356 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:21.203316 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ff109494-c9d8-4a46-98b0-9f8c053d7356 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:21.210251 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ff109494-c9d8-4a46-98b0-9f8c053d7356 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:21.210745 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ff109494-c9d8-4a46-98b0-9f8c053d7356 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:21.212106 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ff109494-c9d8-4a46-98b0-9f8c053d7356 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:21.212552 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ff109494-c9d8-4a46-98b0-9f8c053d7356 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:21.239113 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-ff109494-c9d8-4a46-98b0-9f8c053d7356 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lazy-loading 'flavor' on Instance uuid 7e1399d5-9f28-4b92-a752-a233a1652022 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:49:21.260620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:49:21.326638 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ff109494-c9d8-4a46-98b0-9f8c053d7356 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "POST /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022/action" status: 202 len: 0 microversion: 2.1 time: 0.127599 Aug 03 10:49:21.329707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 367/717] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 3 10:49:21 2022] POST /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:49:21.334466 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:49:21.335239 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=6 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:49:21.344863 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9f402c75-fe74-45a0-99e3-844480c13ec1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:21.345786 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9f402c75-fe74-45a0-99e3-844480c13ec1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:21.354406 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9f402c75-fe74-45a0-99e3-844480c13ec1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:21.355228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9f402c75-fe74-45a0-99e3-844480c13ec1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:21.357110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9f402c75-fe74-45a0-99e3-844480c13ec1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:21.357848 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9f402c75-fe74-45a0-99e3-844480c13ec1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:21.440264 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-f0c31df2-1dc4-4d27-8bca-c1a9fe312903 req-557e60c2-667a-4fdd-b1f2-463ab2ae4160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53cc123d-d9f0-4035-ad45-42ba2f585c90", "name": "network-vif-plugged", "status": "completed", "tag": "124f697b-af93-48b0-a073-3647bab4089e"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:21.447514 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=6 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:49:21.453822 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-f0c31df2-1dc4-4d27-8bca-c1a9fe312903 req-557e60c2-667a-4fdd-b1f2-463ab2ae4160 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:21.454259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-f0c31df2-1dc4-4d27-8bca-c1a9fe312903 req-557e60c2-667a-4fdd-b1f2-463ab2ae4160 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:21.467991 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-f0c31df2-1dc4-4d27-8bca-c1a9fe312903 req-557e60c2-667a-4fdd-b1f2-463ab2ae4160 service nova] Creating event network-vif-plugged:124f697b-af93-48b0-a073-3647bab4089e for instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 on hv-cinder-85083 Aug 03 10:49:21.473792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-f0c31df2-1dc4-4d27-8bca-c1a9fe312903 req-557e60c2-667a-4fdd-b1f2-463ab2ae4160 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037864 Aug 03 10:49:21.474606 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 368/718] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:49:21.543382 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9f402c75-fe74-45a0-99e3-844480c13ec1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:21.551630 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9f402c75-fe74-45a0-99e3-844480c13ec1 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1569 microversion: 2.1 time: 0.217540 Aug 03 10:49:21.552271 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 351/719] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:21 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:21.922958 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ada5d23d-4195-44e4-8d7a-e0300a4a2c4c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:21.923663 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ada5d23d-4195-44e4-8d7a-e0300a4a2c4c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:21.930394 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ada5d23d-4195-44e4-8d7a-e0300a4a2c4c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:21.930843 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ada5d23d-4195-44e4-8d7a-e0300a4a2c4c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:21.931627 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ada5d23d-4195-44e4-8d7a-e0300a4a2c4c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:21.932062 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ada5d23d-4195-44e4-8d7a-e0300a4a2c4c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:22.076544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ada5d23d-4195-44e4-8d7a-e0300a4a2c4c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:22.084249 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ada5d23d-4195-44e4-8d7a-e0300a4a2c4c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1367 microversion: 2.1 time: 0.165539 Aug 03 10:49:22.084836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 369/720] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:21 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:22.573407 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-8ea3d406-fca1-4bab-8f9f-28e2d1c870c9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:22.574046 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-8ea3d406-fca1-4bab-8f9f-28e2d1c870c9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:22.580572 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8ea3d406-fca1-4bab-8f9f-28e2d1c870c9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:22.581023 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8ea3d406-fca1-4bab-8f9f-28e2d1c870c9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:22.581808 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8ea3d406-fca1-4bab-8f9f-28e2d1c870c9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:22.582239 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8ea3d406-fca1-4bab-8f9f-28e2d1c870c9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:22.716017 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-8ea3d406-fca1-4bab-8f9f-28e2d1c870c9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:22.723505 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-8ea3d406-fca1-4bab-8f9f-28e2d1c870c9 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1569 microversion: 2.1 time: 0.154490 Aug 03 10:49:22.724077 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 352/721] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:22 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:22.881881 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-090aec74-054a-4683-b0fa-d103551003a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:22.882373 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-090aec74-054a-4683-b0fa-d103551003a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:22.889297 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-090aec74-054a-4683-b0fa-d103551003a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:22.889783 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-090aec74-054a-4683-b0fa-d103551003a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:22.890540 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-090aec74-054a-4683-b0fa-d103551003a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:22.890973 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-090aec74-054a-4683-b0fa-d103551003a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:22.971308 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-090aec74-054a-4683-b0fa-d103551003a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lazy-loading 'services' on Instance uuid 00b0240d-3638-48b2-a7f3-2269dd2aba05 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:49:23.045732 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-090aec74-054a-4683-b0fa-d103551003a7 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "DELETE /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-volume_attachments/cc559fe6-de81-4a57-9dc2-869907d32217" status: 202 len: 0 microversion: 2.1 time: 0.167560 Aug 03 10:49:23.046332 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 370/722] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 3 10:49:22 2022] DELETE /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-volume_attachments/cc559fe6-de81-4a57-9dc2-869907d32217 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:49:23.055197 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b66b4c6c-f6ff-403b-8821-03b4efd3a8de tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:23.057559 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b66b4c6c-f6ff-403b-8821-03b4efd3a8de tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:23.063534 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b66b4c6c-f6ff-403b-8821-03b4efd3a8de tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:23.063979 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b66b4c6c-f6ff-403b-8821-03b4efd3a8de tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:23.064728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b66b4c6c-f6ff-403b-8821-03b4efd3a8de tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:23.065156 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b66b4c6c-f6ff-403b-8821-03b4efd3a8de tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:23.094467 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b66b4c6c-f6ff-403b-8821-03b4efd3a8de tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043669 Aug 03 10:49:23.095006 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 353/723] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:49:23 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:49:23.106673 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fbabe147-c41c-47b0-8fe7-22a68f3caf89 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:23.107377 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fbabe147-c41c-47b0-8fe7-22a68f3caf89 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:23.113924 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fbabe147-c41c-47b0-8fe7-22a68f3caf89 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:23.114371 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fbabe147-c41c-47b0-8fe7-22a68f3caf89 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:23.115134 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fbabe147-c41c-47b0-8fe7-22a68f3caf89 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:23.115564 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fbabe147-c41c-47b0-8fe7-22a68f3caf89 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:23.244056 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-fbabe147-c41c-47b0-8fe7-22a68f3caf89 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:23.251670 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fbabe147-c41c-47b0-8fe7-22a68f3caf89 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1367 microversion: 2.1 time: 0.149182 Aug 03 10:49:23.252246 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 371/724] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:23 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:49:23.744931 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d1795ceb-4065-4d10-afb9-6adcc8dc196f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:23.745568 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d1795ceb-4065-4d10-afb9-6adcc8dc196f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:23.752086 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d1795ceb-4065-4d10-afb9-6adcc8dc196f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:23.752529 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d1795ceb-4065-4d10-afb9-6adcc8dc196f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:23.753281 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d1795ceb-4065-4d10-afb9-6adcc8dc196f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:23.753739 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d1795ceb-4065-4d10-afb9-6adcc8dc196f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:23.889207 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d1795ceb-4065-4d10-afb9-6adcc8dc196f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:23.896701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d1795ceb-4065-4d10-afb9-6adcc8dc196f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1569 microversion: 2.1 time: 0.155849 Aug 03 10:49:23.897268 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 354/725] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:23 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:24.108465 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f2c2cfd7-ac28-4cc4-858e-cae4ba6b614c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:24.110669 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f2c2cfd7-ac28-4cc4-858e-cae4ba6b614c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:24.118216 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f2c2cfd7-ac28-4cc4-858e-cae4ba6b614c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:24.119071 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f2c2cfd7-ac28-4cc4-858e-cae4ba6b614c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:24.119421 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f2c2cfd7-ac28-4cc4-858e-cae4ba6b614c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:24.119855 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f2c2cfd7-ac28-4cc4-858e-cae4ba6b614c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:24.150769 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f2c2cfd7-ac28-4cc4-858e-cae4ba6b614c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046636 Aug 03 10:49:24.151335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 372/726] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:49:24 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:49:24.271586 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-95745984-1f0b-43eb-a28d-2153c571c38a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:24.272191 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-95745984-1f0b-43eb-a28d-2153c571c38a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:24.278629 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-95745984-1f0b-43eb-a28d-2153c571c38a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:24.279076 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-95745984-1f0b-43eb-a28d-2153c571c38a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:24.279839 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-95745984-1f0b-43eb-a28d-2153c571c38a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:24.280270 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-95745984-1f0b-43eb-a28d-2153c571c38a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:24.415284 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-95745984-1f0b-43eb-a28d-2153c571c38a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:24.417491 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:49:24.424882 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-95745984-1f0b-43eb-a28d-2153c571c38a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1557 microversion: 2.1 time: 0.157096 Aug 03 10:49:24.425489 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 355/727] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:24 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:24.445027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c584135e-b82b-4f84-8ae7-b4817093b9d9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:24.445595 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c584135e-b82b-4f84-8ae7-b4817093b9d9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:24.451694 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c584135e-b82b-4f84-8ae7-b4817093b9d9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:24.452145 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c584135e-b82b-4f84-8ae7-b4817093b9d9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:24.452921 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c584135e-b82b-4f84-8ae7-b4817093b9d9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:24.453372 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c584135e-b82b-4f84-8ae7-b4817093b9d9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:24.529328 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c584135e-b82b-4f84-8ae7-b4817093b9d9 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088121 Aug 03 10:49:24.529952 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 373/728] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 3 10:49:24 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:49:24.918466 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1e0ac64a-afd1-4bea-8d71-f3fc2a3ece7b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:24.919337 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-1e0ac64a-afd1-4bea-8d71-f3fc2a3ece7b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:24.926594 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1e0ac64a-afd1-4bea-8d71-f3fc2a3ece7b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:24.927037 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1e0ac64a-afd1-4bea-8d71-f3fc2a3ece7b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:24.927801 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1e0ac64a-afd1-4bea-8d71-f3fc2a3ece7b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:24.928232 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1e0ac64a-afd1-4bea-8d71-f3fc2a3ece7b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:25.068567 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1e0ac64a-afd1-4bea-8d71-f3fc2a3ece7b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:25.076082 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1e0ac64a-afd1-4bea-8d71-f3fc2a3ece7b tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1569 microversion: 2.1 time: 0.162318 Aug 03 10:49:25.076653 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 356/729] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:24 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:25.163754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-663a326e-1b9d-4fe0-9efb-47c69805babc tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:25.166621 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-663a326e-1b9d-4fe0-9efb-47c69805babc tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:25.172694 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-663a326e-1b9d-4fe0-9efb-47c69805babc tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:25.173145 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-663a326e-1b9d-4fe0-9efb-47c69805babc tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:25.173936 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-663a326e-1b9d-4fe0-9efb-47c69805babc tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:25.174366 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-663a326e-1b9d-4fe0-9efb-47c69805babc tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:25.203889 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-663a326e-1b9d-4fe0-9efb-47c69805babc tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044526 Aug 03 10:49:25.204453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 374/730] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:49:25 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 10:49:25.285285 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-0128733c-36cc-44f6-9f0c-401ac2d14607 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:25.285809 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-0128733c-36cc-44f6-9f0c-401ac2d14607 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:25.292400 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0128733c-36cc-44f6-9f0c-401ac2d14607 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:25.292845 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0128733c-36cc-44f6-9f0c-401ac2d14607 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:25.293625 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0128733c-36cc-44f6-9f0c-401ac2d14607 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:25.294056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0128733c-36cc-44f6-9f0c-401ac2d14607 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:25.318856 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-0128733c-36cc-44f6-9f0c-401ac2d14607 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Going to try to terminate instance {{(pid=124389) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:49:25.403923 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-0128733c-36cc-44f6-9f0c-401ac2d14607 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "DELETE /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 204 len: 0 microversion: 2.1 time: 0.121931 Aug 03 10:49:25.404918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 357/731] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:49:25 2022] DELETE /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:49:25.413674 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-189c90b2-98ea-4221-bf04-30903e5f8c94 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:25.414979 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-189c90b2-98ea-4221-bf04-30903e5f8c94 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:25.421225 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-189c90b2-98ea-4221-bf04-30903e5f8c94 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:25.421712 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-189c90b2-98ea-4221-bf04-30903e5f8c94 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:25.422482 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-189c90b2-98ea-4221-bf04-30903e5f8c94 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:25.422914 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-189c90b2-98ea-4221-bf04-30903e5f8c94 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:25.492986 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-9ecec590-8552-4932-a603-ed43ce9119f6 req-6974e99f-e2c1-4887-8760-9c58224c487f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53cc123d-d9f0-4035-ad45-42ba2f585c90", "tag": "124f697b-af93-48b0-a073-3647bab4089e"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:25.503166 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-9ecec590-8552-4932-a603-ed43ce9119f6 req-6974e99f-e2c1-4887-8760-9c58224c487f service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:25.503611 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-9ecec590-8552-4932-a603-ed43ce9119f6 req-6974e99f-e2c1-4887-8760-9c58224c487f service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:25.515962 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-9ecec590-8552-4932-a603-ed43ce9119f6 req-6974e99f-e2c1-4887-8760-9c58224c487f service nova] Creating event network-changed:124f697b-af93-48b0-a073-3647bab4089e for instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 on hv-cinder-85083 Aug 03 10:49:25.521106 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-9ecec590-8552-4932-a603-ed43ce9119f6 req-6974e99f-e2c1-4887-8760-9c58224c487f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032645 Aug 03 10:49:25.521940 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 358/732] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:49:25.565199 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-189c90b2-98ea-4221-bf04-30903e5f8c94 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:25.572690 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-189c90b2-98ea-4221-bf04-30903e5f8c94 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1690 microversion: 2.1 time: 0.162971 Aug 03 10:49:25.573266 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 375/733] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:25 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:26.098394 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5fce73c6-da09-4b66-abe6-5c33a9729ba7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:26.099093 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-5fce73c6-da09-4b66-abe6-5c33a9729ba7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:26.106138 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5fce73c6-da09-4b66-abe6-5c33a9729ba7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:26.106583 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5fce73c6-da09-4b66-abe6-5c33a9729ba7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:26.107351 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5fce73c6-da09-4b66-abe6-5c33a9729ba7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:26.107782 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5fce73c6-da09-4b66-abe6-5c33a9729ba7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:26.242756 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5fce73c6-da09-4b66-abe6-5c33a9729ba7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:26.250350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5fce73c6-da09-4b66-abe6-5c33a9729ba7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1569 microversion: 2.1 time: 0.156882 Aug 03 10:49:26.251143 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 359/734] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:26 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:26.594322 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-614a9d18-9436-42db-a53c-48e699a738e9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:26.594924 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-614a9d18-9436-42db-a53c-48e699a738e9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:26.602251 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-614a9d18-9436-42db-a53c-48e699a738e9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:26.602715 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-614a9d18-9436-42db-a53c-48e699a738e9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:26.603494 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-614a9d18-9436-42db-a53c-48e699a738e9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:26.603921 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-614a9d18-9436-42db-a53c-48e699a738e9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:26.738249 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-614a9d18-9436-42db-a53c-48e699a738e9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:26.746855 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-614a9d18-9436-42db-a53c-48e699a738e9 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1690 microversion: 2.1 time: 0.156512 Aug 03 10:49:26.747458 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 376/735] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:26 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:27.272265 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c3f801ec-2836-45b0-b368-f31433eae1d8 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:27.272955 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-c3f801ec-2836-45b0-b368-f31433eae1d8 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:27.280571 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c3f801ec-2836-45b0-b368-f31433eae1d8 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:27.281017 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c3f801ec-2836-45b0-b368-f31433eae1d8 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:27.281842 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c3f801ec-2836-45b0-b368-f31433eae1d8 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:27.282274 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c3f801ec-2836-45b0-b368-f31433eae1d8 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:27.426318 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c3f801ec-2836-45b0-b368-f31433eae1d8 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:27.434482 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c3f801ec-2836-45b0-b368-f31433eae1d8 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1569 microversion: 2.1 time: 0.166129 Aug 03 10:49:27.435056 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 360/736] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:27 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:27.769251 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7c816814-5331-437e-b72a-b62164e9e97f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:27.769891 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7c816814-5331-437e-b72a-b62164e9e97f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:27.776878 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7c816814-5331-437e-b72a-b62164e9e97f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:27.777328 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7c816814-5331-437e-b72a-b62164e9e97f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:27.778137 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7c816814-5331-437e-b72a-b62164e9e97f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:27.778574 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7c816814-5331-437e-b72a-b62164e9e97f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:27.909826 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7c816814-5331-437e-b72a-b62164e9e97f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:27.918286 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7c816814-5331-437e-b72a-b62164e9e97f tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1690 microversion: 2.1 time: 0.152804 Aug 03 10:49:27.918880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 377/737] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:27 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:28.456528 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c8f481bd-b533-418f-8bfa-81be618db9e5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:28.457135 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-c8f481bd-b533-418f-8bfa-81be618db9e5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:28.464672 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c8f481bd-b533-418f-8bfa-81be618db9e5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:28.465487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c8f481bd-b533-418f-8bfa-81be618db9e5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:28.465830 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c8f481bd-b533-418f-8bfa-81be618db9e5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:28.466262 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c8f481bd-b533-418f-8bfa-81be618db9e5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:28.602910 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c8f481bd-b533-418f-8bfa-81be618db9e5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:28.610642 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c8f481bd-b533-418f-8bfa-81be618db9e5 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1569 microversion: 2.1 time: 0.157919 Aug 03 10:49:28.611220 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 361/738] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:28 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:28.940560 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8a2aa7ed-e899-44fb-9618-9c4b1a201d1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:28.941104 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8a2aa7ed-e899-44fb-9618-9c4b1a201d1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:28.949248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8a2aa7ed-e899-44fb-9618-9c4b1a201d1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:28.949796 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8a2aa7ed-e899-44fb-9618-9c4b1a201d1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:28.950620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8a2aa7ed-e899-44fb-9618-9c4b1a201d1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:28.951056 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8a2aa7ed-e899-44fb-9618-9c4b1a201d1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:29.097875 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8a2aa7ed-e899-44fb-9618-9c4b1a201d1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:29.107390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8a2aa7ed-e899-44fb-9618-9c4b1a201d1c tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1690 microversion: 2.1 time: 0.170786 Aug 03 10:49:29.107966 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 378/739] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:28 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:29.632208 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-67583f55-513a-4f09-a7cf-f1b28605c228 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:29.632938 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-67583f55-513a-4f09-a7cf-f1b28605c228 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:29.639473 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-67583f55-513a-4f09-a7cf-f1b28605c228 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:29.639922 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-67583f55-513a-4f09-a7cf-f1b28605c228 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:29.640689 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-67583f55-513a-4f09-a7cf-f1b28605c228 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:29.641121 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-67583f55-513a-4f09-a7cf-f1b28605c228 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:29.779756 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-67583f55-513a-4f09-a7cf-f1b28605c228 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:29.787478 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-67583f55-513a-4f09-a7cf-f1b28605c228 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1569 microversion: 2.1 time: 0.159233 Aug 03 10:49:29.788059 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 362/740] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:29 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:30.129270 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-25f69e44-802f-4a35-aa4f-b48a1172ed11 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:30.129927 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-25f69e44-802f-4a35-aa4f-b48a1172ed11 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:30.137144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-25f69e44-802f-4a35-aa4f-b48a1172ed11 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:30.137629 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-25f69e44-802f-4a35-aa4f-b48a1172ed11 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:30.138410 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-25f69e44-802f-4a35-aa4f-b48a1172ed11 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:30.138842 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-25f69e44-802f-4a35-aa4f-b48a1172ed11 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:30.293007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-25f69e44-802f-4a35-aa4f-b48a1172ed11 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:30.301183 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-25f69e44-802f-4a35-aa4f-b48a1172ed11 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1690 microversion: 2.1 time: 0.175827 Aug 03 10:49:30.312103 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 379/741] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:30 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1690 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:30.735014 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-85961a3b-4c71-4a7e-b272-81c8bdddd5ef req-0a6b5ad7-a944-49d7-8d9e-829442fd35c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b0240d-3638-48b2-a7f3-2269dd2aba05", "name": "network-vif-deleted", "tag": "3a081129-4296-482f-9f57-79ce242de7a4"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:30.745842 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-85961a3b-4c71-4a7e-b272-81c8bdddd5ef req-0a6b5ad7-a944-49d7-8d9e-829442fd35c9 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:30.746285 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-85961a3b-4c71-4a7e-b272-81c8bdddd5ef req-0a6b5ad7-a944-49d7-8d9e-829442fd35c9 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:30.758743 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-85961a3b-4c71-4a7e-b272-81c8bdddd5ef req-0a6b5ad7-a944-49d7-8d9e-829442fd35c9 service nova] Creating event network-vif-deleted:3a081129-4296-482f-9f57-79ce242de7a4 for instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 on hv-cinder-85083 Aug 03 10:49:30.763934 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-85961a3b-4c71-4a7e-b272-81c8bdddd5ef req-0a6b5ad7-a944-49d7-8d9e-829442fd35c9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032502 Aug 03 10:49:30.764516 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 363/742] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:49:30.809960 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0d21d657-2a58-4fae-9a19-c4d4029570c7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:30.812640 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0d21d657-2a58-4fae-9a19-c4d4029570c7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:30.822238 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d21d657-2a58-4fae-9a19-c4d4029570c7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:30.822935 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d21d657-2a58-4fae-9a19-c4d4029570c7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:30.823740 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d21d657-2a58-4fae-9a19-c4d4029570c7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:30.824233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d21d657-2a58-4fae-9a19-c4d4029570c7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:30.999986 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0d21d657-2a58-4fae-9a19-c4d4029570c7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:31.003098 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0d21d657-2a58-4fae-9a19-c4d4029570c7 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1569 microversion: 2.1 time: 0.198119 Aug 03 10:49:31.003749 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 380/743] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:30 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:31.340832 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-677ab97f-74c7-4b45-a4be-587d2cc5be2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:31.342737 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-677ab97f-74c7-4b45-a4be-587d2cc5be2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:31.357126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-677ab97f-74c7-4b45-a4be-587d2cc5be2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:31.359130 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-677ab97f-74c7-4b45-a4be-587d2cc5be2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:31.360799 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-677ab97f-74c7-4b45-a4be-587d2cc5be2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:31.362385 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-677ab97f-74c7-4b45-a4be-587d2cc5be2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:31.421209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-677ab97f-74c7-4b45-a4be-587d2cc5be2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:31.421754 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-677ab97f-74c7-4b45-a4be-587d2cc5be2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:31.422206 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-677ab97f-74c7-4b45-a4be-587d2cc5be2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lazy-loading 'fault' on Instance uuid 00b0240d-3638-48b2-a7f3-2269dd2aba05 {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:49:31.474711 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-677ab97f-74c7-4b45-a4be-587d2cc5be2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:31.481764 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-677ab97f-74c7-4b45-a4be-587d2cc5be2d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 200 len: 1336 microversion: 2.1 time: 0.150699 Aug 03 10:49:31.482340 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 364/744] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:31 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 1336 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:32.024710 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-39b657a5-93d0-4a7b-a9de-6a77d06d2f5c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:32.025357 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-39b657a5-93d0-4a7b-a9de-6a77d06d2f5c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:32.032705 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-39b657a5-93d0-4a7b-a9de-6a77d06d2f5c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:32.033150 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-39b657a5-93d0-4a7b-a9de-6a77d06d2f5c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:32.033977 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-39b657a5-93d0-4a7b-a9de-6a77d06d2f5c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:32.034405 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-39b657a5-93d0-4a7b-a9de-6a77d06d2f5c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:32.197225 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-39b657a5-93d0-4a7b-a9de-6a77d06d2f5c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:32.205541 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-39b657a5-93d0-4a7b-a9de-6a77d06d2f5c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1569 microversion: 2.1 time: 0.184877 Aug 03 10:49:32.206143 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 381/745] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:32 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:49:32.502913 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3b6edca1-efd4-435a-ae27-40e2ed27cfa4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:32.503501 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3b6edca1-efd4-435a-ae27-40e2ed27cfa4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: 00b0240d-3638-48b2-a7f3-2269dd2aba05] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:32.510767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3b6edca1-efd4-435a-ae27-40e2ed27cfa4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:32.511213 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3b6edca1-efd4-435a-ae27-40e2ed27cfa4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:32.512012 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3b6edca1-efd4-435a-ae27-40e2ed27cfa4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:32.512440 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3b6edca1-efd4-435a-ae27-40e2ed27cfa4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:32.529246 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-3b6edca1-efd4-435a-ae27-40e2ed27cfa4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] HTTP exception thrown: Instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 could not be found. Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3b6edca1-efd4-435a-ae27-40e2ed27cfa4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Request method failure captured: Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 HTTP/1.1 Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lF2pOWmhCbmjifspfqKpHzAxIhbE2uFuR1reDQeN7S2zka5yP-6of9k_LGD6SROhSzwAA7evRUOk4uaXIt5tYTAzEQECkaYCrzI0Aqtaz-VJZl5OF72sMI3bRVG5PZbcMDIsDqI_MOs7HwjGb9gR7eJuQbd-puQcPhNc0yJtZc7Oks Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: ca8789771e8a4505866424b6c7748291 Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168500966 Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:49:32.530969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:49:32.532542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca8789771e8a4505866424b6c7748291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca8789771e8a4505866424b6c7748291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca8789771e8a4505866424b6c7748291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca8789771e8a4505866424b6c7748291", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:49:32.532542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168500966 Aug 03 10:49:32.532542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: ca8789771e8a4505866424b6c7748291 Aug 03 10:49:32.532542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168500966 Aug 03 10:49:32.532542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-ServerRescueNegativeTestJSON-168500966-project Aug 03 10:49:32.532542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:49:32.532542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:49:32.532542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: a5e714aad25f4fda8acf767ad7e2490b Aug 03 10:49:32.532542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168500966-project Aug 03 10:49:32.532542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:49:32.532542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 could not be found. Aug 03 10:49:32.532542 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '00b0240d-3638-48b2-a7f3-2269dd2aba05'} Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 could not be found. Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:49:32.533399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 could not be found. Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 could not be found. Aug 03 10:49:32.534695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:49:32.535805 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3b6edca1-efd4-435a-ae27-40e2ed27cfa4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Returning 404 to user: Instance 00b0240d-3638-48b2-a7f3-2269dd2aba05 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:49:32.535805 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3b6edca1-efd4-435a-ae27-40e2ed27cfa4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05" status: 404 len: 111 microversion: 2.1 time: 0.033391 Aug 03 10:49:32.535805 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 365/746] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:32 2022] GET /compute/v2.1/servers/00b0240d-3638-48b2-a7f3-2269dd2aba05 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:49:32.541994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4e74cbcd-cb7b-4ab8-930b-bf17ab6ece16 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '.version_select at 0x7fbd105fff70>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:32.563601 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4e74cbcd-cb7b-4ab8-930b-bf17ab6ece16 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1336649481" status: 202 len: 0 microversion: 2.1 time: 0.026215 Aug 03 10:49:32.564311 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 382/747] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Aug 3 10:49:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1336649481 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:49:33.228852 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c04d01da-d76a-45e9-be98-8bb0b45aeee0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:33.229503 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-c04d01da-d76a-45e9-be98-8bb0b45aeee0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:33.236434 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c04d01da-d76a-45e9-be98-8bb0b45aeee0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:33.236879 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c04d01da-d76a-45e9-be98-8bb0b45aeee0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:33.237704 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c04d01da-d76a-45e9-be98-8bb0b45aeee0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:33.238410 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c04d01da-d76a-45e9-be98-8bb0b45aeee0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:33.379692 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c04d01da-d76a-45e9-be98-8bb0b45aeee0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:33.388443 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c04d01da-d76a-45e9-be98-8bb0b45aeee0 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1569 microversion: 2.1 time: 0.163513 Aug 03 10:49:33.389026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 366/748] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:33 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:34.410544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-399dbd32-51b1-45d1-b0e6-07d1e06f3254 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:34.423965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-399dbd32-51b1-45d1-b0e6-07d1e06f3254 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:34.430591 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-399dbd32-51b1-45d1-b0e6-07d1e06f3254 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:34.431037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-399dbd32-51b1-45d1-b0e6-07d1e06f3254 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:34.431829 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-399dbd32-51b1-45d1-b0e6-07d1e06f3254 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:34.432276 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-399dbd32-51b1-45d1-b0e6-07d1e06f3254 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:34.586795 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-399dbd32-51b1-45d1-b0e6-07d1e06f3254 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:34.596732 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-399dbd32-51b1-45d1-b0e6-07d1e06f3254 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1510 microversion: 2.1 time: 0.191010 Aug 03 10:49:34.597343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 383/749] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:34 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:34.619276 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4c14f5f8-9a26-4832-91d3-488a1ad033ed tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:34.619875 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4c14f5f8-9a26-4832-91d3-488a1ad033ed tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:34.627115 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4c14f5f8-9a26-4832-91d3-488a1ad033ed tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:34.627571 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4c14f5f8-9a26-4832-91d3-488a1ad033ed tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:34.628413 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4c14f5f8-9a26-4832-91d3-488a1ad033ed tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:34.628854 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4c14f5f8-9a26-4832-91d3-488a1ad033ed tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:34.660476 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4c14f5f8-9a26-4832-91d3-488a1ad033ed tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124389) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 10:49:34.728711 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-4c14f5f8-9a26-4832-91d3-488a1ad033ed tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "POST /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022/action" status: 202 len: 0 microversion: 2.1 time: 0.113728 Aug 03 10:49:34.729663 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 367/750] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 3 10:49:34 2022] POST /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 10:49:34.739634 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-25a77e34-5986-4f04-a9c4-310d4f929a5e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:34.740396 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-25a77e34-5986-4f04-a9c4-310d4f929a5e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:34.746963 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-25a77e34-5986-4f04-a9c4-310d4f929a5e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:34.747402 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-25a77e34-5986-4f04-a9c4-310d4f929a5e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:34.748185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-25a77e34-5986-4f04-a9c4-310d4f929a5e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:34.748624 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-25a77e34-5986-4f04-a9c4-310d4f929a5e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:34.753319 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:49:34.952657 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-25a77e34-5986-4f04-a9c4-310d4f929a5e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:34.960864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-25a77e34-5986-4f04-a9c4-310d4f929a5e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1518 microversion: 2.1 time: 0.225319 Aug 03 10:49:34.961483 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 384/751] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:34 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1518 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:35.459831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-7ccf05e4-f2a0-47cf-b836-dd8a1803a3fa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:35.460343 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-7ccf05e4-f2a0-47cf-b836-dd8a1803a3fa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:35.471783 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-e800da38-a413-4802-a4f0-612434722647 req-5546fc8d-f8e8-42a4-824a-edae76773cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e1399d5-9f28-4b92-a752-a233a1652022", "name": "network-vif-unplugged", "status": "completed", "tag": "ea1ca950-d067-4257-9371-6667208eda63"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:35.484498 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7ccf05e4-f2a0-47cf-b836-dd8a1803a3fa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:35.484498 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7ccf05e4-f2a0-47cf-b836-dd8a1803a3fa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:35.484498 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7ccf05e4-f2a0-47cf-b836-dd8a1803a3fa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:35.485395 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7ccf05e4-f2a0-47cf-b836-dd8a1803a3fa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:35.501756 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e800da38-a413-4802-a4f0-612434722647 req-5546fc8d-f8e8-42a4-824a-edae76773cfb service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:35.502881 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e800da38-a413-4802-a4f0-612434722647 req-5546fc8d-f8e8-42a4-824a-edae76773cfb service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:35.517886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-7ccf05e4-f2a0-47cf-b836-dd8a1803a3fa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Going to try to terminate instance {{(pid=124389) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:49:35.522714 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.compute.server_external_events [req-e800da38-a413-4802-a4f0-612434722647 req-5546fc8d-f8e8-42a4-824a-edae76773cfb service nova] Unable to find a host for instance 7e1399d5-9f28-4b92-a752-a233a1652022. Dropping event network-vif-unplugged {{(pid=124388) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 10:49:35.524177 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-e800da38-a413-4802-a4f0-612434722647 req-5546fc8d-f8e8-42a4-824a-edae76773cfb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.061945 Aug 03 10:49:35.525091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 385/752] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 65 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 03 10:49:35.610749 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-7ccf05e4-f2a0-47cf-b836-dd8a1803a3fa tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 204 len: 0 microversion: 2.1 time: 0.154505 Aug 03 10:49:35.616168 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 368/753] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:49:35 2022] DELETE /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:49:35.622474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c3950332-d60e-4316-9155-8eee953e36c4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:35.623508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c3950332-d60e-4316-9155-8eee953e36c4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:35.630082 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c3950332-d60e-4316-9155-8eee953e36c4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:35.630542 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c3950332-d60e-4316-9155-8eee953e36c4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:35.631445 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c3950332-d60e-4316-9155-8eee953e36c4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:35.631829 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c3950332-d60e-4316-9155-8eee953e36c4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:35.778568 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c3950332-d60e-4316-9155-8eee953e36c4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:35.786649 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c3950332-d60e-4316-9155-8eee953e36c4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1509 microversion: 2.1 time: 0.169193 Aug 03 10:49:35.787233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 386/754] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:35 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:35.983562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3ad56c66-ea22-4771-8bb9-9e8ad523973e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:35.984254 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3ad56c66-ea22-4771-8bb9-9e8ad523973e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:35.991057 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3ad56c66-ea22-4771-8bb9-9e8ad523973e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:35.991499 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3ad56c66-ea22-4771-8bb9-9e8ad523973e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:35.992937 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3ad56c66-ea22-4771-8bb9-9e8ad523973e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:35.993366 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3ad56c66-ea22-4771-8bb9-9e8ad523973e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:36.130012 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3ad56c66-ea22-4771-8bb9-9e8ad523973e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:36.132395 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:49:36.140433 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3ad56c66-ea22-4771-8bb9-9e8ad523973e tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1518 microversion: 2.1 time: 0.161044 Aug 03 10:49:36.141058 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 369/755] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:35 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:36.807807 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1d5aafcf-1577-490a-b265-2886b9caff2e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:36.808324 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1d5aafcf-1577-490a-b265-2886b9caff2e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:36.814907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1d5aafcf-1577-490a-b265-2886b9caff2e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:36.815367 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1d5aafcf-1577-490a-b265-2886b9caff2e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:36.816130 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1d5aafcf-1577-490a-b265-2886b9caff2e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:36.816563 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1d5aafcf-1577-490a-b265-2886b9caff2e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:36.942927 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1d5aafcf-1577-490a-b265-2886b9caff2e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:36.951178 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1d5aafcf-1577-490a-b265-2886b9caff2e tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1509 microversion: 2.1 time: 0.147300 Aug 03 10:49:36.951754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 387/756] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:36 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:37.162370 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-07c5f554-5a6b-4bfa-8791-787640d2a603 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:37.162948 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-07c5f554-5a6b-4bfa-8791-787640d2a603 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:37.170219 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-07c5f554-5a6b-4bfa-8791-787640d2a603 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:37.170670 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-07c5f554-5a6b-4bfa-8791-787640d2a603 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:37.171434 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-07c5f554-5a6b-4bfa-8791-787640d2a603 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:37.171870 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-07c5f554-5a6b-4bfa-8791-787640d2a603 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:37.305514 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-07c5f554-5a6b-4bfa-8791-787640d2a603 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:37.313221 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-07c5f554-5a6b-4bfa-8791-787640d2a603 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1518 microversion: 2.1 time: 0.155087 Aug 03 10:49:37.313833 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 370/757] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:37 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:37.972404 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-eb65befc-0874-4227-85f3-c37ebac56b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:37.973387 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-eb65befc-0874-4227-85f3-c37ebac56b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:37.981272 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eb65befc-0874-4227-85f3-c37ebac56b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:37.981757 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eb65befc-0874-4227-85f3-c37ebac56b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:37.982540 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eb65befc-0874-4227-85f3-c37ebac56b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:37.982974 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eb65befc-0874-4227-85f3-c37ebac56b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:38.124649 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-eb65befc-0874-4227-85f3-c37ebac56b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:38.132694 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-eb65befc-0874-4227-85f3-c37ebac56b05 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1509 microversion: 2.1 time: 0.164462 Aug 03 10:49:38.133295 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 388/758] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:37 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:38.337076 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4ec44fe3-9351-4e52-9ef7-39e35f36947a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:38.337815 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4ec44fe3-9351-4e52-9ef7-39e35f36947a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:38.345896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4ec44fe3-9351-4e52-9ef7-39e35f36947a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:38.346342 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4ec44fe3-9351-4e52-9ef7-39e35f36947a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:38.347125 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4ec44fe3-9351-4e52-9ef7-39e35f36947a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:38.347582 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4ec44fe3-9351-4e52-9ef7-39e35f36947a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:38.507062 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4ec44fe3-9351-4e52-9ef7-39e35f36947a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:38.529600 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-4ec44fe3-9351-4e52-9ef7-39e35f36947a tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1520 microversion: 2.1 time: 0.196852 Aug 03 10:49:38.530389 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 371/759] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:38 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:38.674744 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-dc00f303-5f89-4d54-b770-39e71538f1b0 req-880ffb2d-5a40-4dbf-94e7-a181f7b7d5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffac1966-f7c4-4029-89d1-2d7010eba5da", "name": "network-vif-deleted", "tag": "be45d1ac-e48b-4761-bcee-1161cea179a4"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:38.693347 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-dc00f303-5f89-4d54-b770-39e71538f1b0 req-880ffb2d-5a40-4dbf-94e7-a181f7b7d5ec service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:38.693829 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-dc00f303-5f89-4d54-b770-39e71538f1b0 req-880ffb2d-5a40-4dbf-94e7-a181f7b7d5ec service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:38.706516 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-dc00f303-5f89-4d54-b770-39e71538f1b0 req-880ffb2d-5a40-4dbf-94e7-a181f7b7d5ec service nova] Creating event network-vif-deleted:be45d1ac-e48b-4761-bcee-1161cea179a4 for instance ffac1966-f7c4-4029-89d1-2d7010eba5da on hv-cinder-85083 Aug 03 10:49:38.712440 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-dc00f303-5f89-4d54-b770-39e71538f1b0 req-880ffb2d-5a40-4dbf-94e7-a181f7b7d5ec service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134777 Aug 03 10:49:38.713051 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 389/760] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:49:39.155450 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e59df6e7-4131-4c7e-8bb1-4675f877958d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:39.155950 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e59df6e7-4131-4c7e-8bb1-4675f877958d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:39.162650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e59df6e7-4131-4c7e-8bb1-4675f877958d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:39.163107 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e59df6e7-4131-4c7e-8bb1-4675f877958d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:39.164708 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e59df6e7-4131-4c7e-8bb1-4675f877958d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:39.164835 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e59df6e7-4131-4c7e-8bb1-4675f877958d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:39.207531 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e59df6e7-4131-4c7e-8bb1-4675f877958d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:39.208331 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e59df6e7-4131-4c7e-8bb1-4675f877958d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:39.209326 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-e59df6e7-4131-4c7e-8bb1-4675f877958d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lazy-loading 'fault' on Instance uuid ffac1966-f7c4-4029-89d1-2d7010eba5da {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:49:39.258694 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e59df6e7-4131-4c7e-8bb1-4675f877958d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:39.267085 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e59df6e7-4131-4c7e-8bb1-4675f877958d tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 200 len: 1312 microversion: 2.1 time: 0.115940 Aug 03 10:49:39.267672 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 372/761] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:39 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:39.563146 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d9f2a235-e842-44ab-a0b7-e07c23ec9bbf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:39.563855 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d9f2a235-e842-44ab-a0b7-e07c23ec9bbf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:39.571385 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d9f2a235-e842-44ab-a0b7-e07c23ec9bbf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:39.571833 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d9f2a235-e842-44ab-a0b7-e07c23ec9bbf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:39.572608 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d9f2a235-e842-44ab-a0b7-e07c23ec9bbf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:39.573042 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d9f2a235-e842-44ab-a0b7-e07c23ec9bbf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:39.719586 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d9f2a235-e842-44ab-a0b7-e07c23ec9bbf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:39.729928 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d9f2a235-e842-44ab-a0b7-e07c23ec9bbf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1576 microversion: 2.1 time: 0.171392 Aug 03 10:49:39.730520 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 390/762] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:39 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:40.290216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ad484d4e-2b4f-4f1a-8f4b-9f591fdd2ec4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:40.290795 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-ad484d4e-2b4f-4f1a-8f4b-9f591fdd2ec4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: ffac1966-f7c4-4029-89d1-2d7010eba5da] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:40.297044 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ad484d4e-2b4f-4f1a-8f4b-9f591fdd2ec4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:40.297517 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ad484d4e-2b4f-4f1a-8f4b-9f591fdd2ec4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:40.298296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ad484d4e-2b4f-4f1a-8f4b-9f591fdd2ec4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:40.298758 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ad484d4e-2b4f-4f1a-8f4b-9f591fdd2ec4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:40.313998 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-ad484d4e-2b4f-4f1a-8f4b-9f591fdd2ec4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] HTTP exception thrown: Instance ffac1966-f7c4-4029-89d1-2d7010eba5da could not be found. Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ad484d4e-2b4f-4f1a-8f4b-9f591fdd2ec4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Request method failure captured: Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da HTTP/1.1 Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lF2pOWmhCbmjifspfqKpHzAxIhbE2uFuR1reDQeN7S2zka5yP-6of9k_LGD6SROhSzwAA7evRUOk4uaXIt5tYTAzEQECkaYCrzI0Aqtaz-VJZl5OF72sMI3bRVG5PZbcMDIsDqI_MOs7HwjGb9gR7eJuQbd-puQcPhNc0yJtZc7Oks Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: ca8789771e8a4505866424b6c7748291 Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168500966 Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:49:40.315683 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:49:40.318243 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca8789771e8a4505866424b6c7748291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca8789771e8a4505866424b6c7748291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca8789771e8a4505866424b6c7748291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca8789771e8a4505866424b6c7748291", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:49:40.318243 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168500966 Aug 03 10:49:40.318243 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: ca8789771e8a4505866424b6c7748291 Aug 03 10:49:40.318243 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168500966 Aug 03 10:49:40.318243 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-ServerRescueNegativeTestJSON-168500966-project Aug 03 10:49:40.318243 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:49:40.318243 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:49:40.318243 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: a5e714aad25f4fda8acf767ad7e2490b Aug 03 10:49:40.318243 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168500966-project Aug 03 10:49:40.318243 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:49:40.318243 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance ffac1966-f7c4-4029-89d1-2d7010eba5da could not be found. Aug 03 10:49:40.318243 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': 'ffac1966-f7c4-4029-89d1-2d7010eba5da'} Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffac1966-f7c4-4029-89d1-2d7010eba5da could not be found. Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:49:40.319562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffac1966-f7c4-4029-89d1-2d7010eba5da could not be found. Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffac1966-f7c4-4029-89d1-2d7010eba5da could not be found. Aug 03 10:49:40.322639 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:49:40.324489 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ad484d4e-2b4f-4f1a-8f4b-9f591fdd2ec4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Returning 404 to user: Instance ffac1966-f7c4-4029-89d1-2d7010eba5da could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:49:40.324489 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ad484d4e-2b4f-4f1a-8f4b-9f591fdd2ec4 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da" status: 404 len: 111 microversion: 2.1 time: 0.030890 Aug 03 10:49:40.324489 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 373/763] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:40 2022] GET /compute/v2.1/servers/ffac1966-f7c4-4029-89d1-2d7010eba5da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:49:40.327159 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b5aa8f2a-257f-4c87-a0e8-e4dded9c0131 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:40.327690 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b5aa8f2a-257f-4c87-a0e8-e4dded9c0131 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:40.334156 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b5aa8f2a-257f-4c87-a0e8-e4dded9c0131 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:40.334612 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b5aa8f2a-257f-4c87-a0e8-e4dded9c0131 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:40.335412 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b5aa8f2a-257f-4c87-a0e8-e4dded9c0131 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:40.335853 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b5aa8f2a-257f-4c87-a0e8-e4dded9c0131 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:40.361702 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b5aa8f2a-257f-4c87-a0e8-e4dded9c0131 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:49:40.441885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b5aa8f2a-257f-4c87-a0e8-e4dded9c0131 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "DELETE /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 204 len: 0 microversion: 2.1 time: 0.118269 Aug 03 10:49:40.443458 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 391/764] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:49:40 2022] DELETE /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:49:40.452830 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-604aa69b-40e8-4096-9141-ad39932fa4cd tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:40.453673 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-604aa69b-40e8-4096-9141-ad39932fa4cd tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:40.459812 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-604aa69b-40e8-4096-9141-ad39932fa4cd tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:40.460264 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-604aa69b-40e8-4096-9141-ad39932fa4cd tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:40.461713 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-604aa69b-40e8-4096-9141-ad39932fa4cd tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:40.462159 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-604aa69b-40e8-4096-9141-ad39932fa4cd tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:40.752637 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-af0fb311-bef1-479b-a42b-03a9a01409fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:40.753516 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-af0fb311-bef1-479b-a42b-03a9a01409fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:40.760542 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-af0fb311-bef1-479b-a42b-03a9a01409fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:40.760995 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-af0fb311-bef1-479b-a42b-03a9a01409fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:40.761804 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-af0fb311-bef1-479b-a42b-03a9a01409fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:40.762720 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-af0fb311-bef1-479b-a42b-03a9a01409fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:40.849651 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-604aa69b-40e8-4096-9141-ad39932fa4cd tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:40.857418 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-604aa69b-40e8-4096-9141-ad39932fa4cd tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.409323 Aug 03 10:49:40.858046 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 374/765] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:40 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:40.922018 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-af0fb311-bef1-479b-a42b-03a9a01409fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:40.930405 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-af0fb311-bef1-479b-a42b-03a9a01409fb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1576 microversion: 2.1 time: 0.181347 Aug 03 10:49:40.931014 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 392/766] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:40 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:49:41.880784 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-65d3c893-6298-4b0c-9817-9af111297109 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:41.881383 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-65d3c893-6298-4b0c-9817-9af111297109 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:41.889065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-65d3c893-6298-4b0c-9817-9af111297109 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:41.889538 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-65d3c893-6298-4b0c-9817-9af111297109 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:41.890336 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-65d3c893-6298-4b0c-9817-9af111297109 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:41.890767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-65d3c893-6298-4b0c-9817-9af111297109 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:41.952975 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bcfbbb62-34fe-4161-b210-4d79462f6279 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:41.953691 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bcfbbb62-34fe-4161-b210-4d79462f6279 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:41.956316 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:49:41.962299 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcfbbb62-34fe-4161-b210-4d79462f6279 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:41.962754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcfbbb62-34fe-4161-b210-4d79462f6279 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:41.963557 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcfbbb62-34fe-4161-b210-4d79462f6279 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:41.963997 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcfbbb62-34fe-4161-b210-4d79462f6279 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:42.092035 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-65d3c893-6298-4b0c-9817-9af111297109 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:42.099930 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-65d3c893-6298-4b0c-9817-9af111297109 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.223344 Aug 03 10:49:42.100606 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 375/767] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:41 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:42.131686 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bcfbbb62-34fe-4161-b210-4d79462f6279 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:42.139412 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bcfbbb62-34fe-4161-b210-4d79462f6279 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1576 microversion: 2.1 time: 0.191544 Aug 03 10:49:42.139997 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 393/768] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:41 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:43.122692 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9f3c3c18-ae8b-49d7-81b1-b52a83cc7a01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:43.123543 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9f3c3c18-ae8b-49d7-81b1-b52a83cc7a01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:43.130298 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9f3c3c18-ae8b-49d7-81b1-b52a83cc7a01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:43.130751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9f3c3c18-ae8b-49d7-81b1-b52a83cc7a01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:43.131546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9f3c3c18-ae8b-49d7-81b1-b52a83cc7a01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:43.131979 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9f3c3c18-ae8b-49d7-81b1-b52a83cc7a01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:43.163652 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-be400cb5-3a5d-4973-931a-356161e0f554 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:43.164823 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-be400cb5-3a5d-4973-931a-356161e0f554 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:43.176963 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be400cb5-3a5d-4973-931a-356161e0f554 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:43.177823 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be400cb5-3a5d-4973-931a-356161e0f554 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:43.179264 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be400cb5-3a5d-4973-931a-356161e0f554 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:43.180414 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be400cb5-3a5d-4973-931a-356161e0f554 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:43.362112 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9f3c3c18-ae8b-49d7-81b1-b52a83cc7a01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:43.376086 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9f3c3c18-ae8b-49d7-81b1-b52a83cc7a01 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1522 microversion: 2.1 time: 0.256717 Aug 03 10:49:43.381457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 376/769] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:43 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:43.389330 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-be400cb5-3a5d-4973-931a-356161e0f554 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:43.397573 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-be400cb5-3a5d-4973-931a-356161e0f554 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1576 microversion: 2.1 time: 0.240689 Aug 03 10:49:43.398163 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 394/770] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:43 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:49:44.156903 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-9dbe60c6-6ebf-43f0-9c31-518b364c1b15 req-acfb65dd-8695-404c-8808-b41e40dfd436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da275cd5-e209-45c5-a46e-3082d668a6b5", "name": "network-vif-deleted", "tag": "7a2adba4-8abd-4f8c-a020-c7fae10e3050"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:44.169039 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-9dbe60c6-6ebf-43f0-9c31-518b364c1b15 req-acfb65dd-8695-404c-8808-b41e40dfd436 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:44.169397 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-9dbe60c6-6ebf-43f0-9c31-518b364c1b15 req-acfb65dd-8695-404c-8808-b41e40dfd436 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:44.183537 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-9dbe60c6-6ebf-43f0-9c31-518b364c1b15 req-acfb65dd-8695-404c-8808-b41e40dfd436 service nova] Creating event network-vif-deleted:7a2adba4-8abd-4f8c-a020-c7fae10e3050 for instance da275cd5-e209-45c5-a46e-3082d668a6b5 on hv-cinder-85083 Aug 03 10:49:44.189629 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-9dbe60c6-6ebf-43f0-9c31-518b364c1b15 req-acfb65dd-8695-404c-8808-b41e40dfd436 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036209 Aug 03 10:49:44.190422 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 377/771] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:49:44.398491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-57bdcd90-6e63-474c-b5c9-6ca73a615ca1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:44.399099 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-57bdcd90-6e63-474c-b5c9-6ca73a615ca1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:44.405322 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57bdcd90-6e63-474c-b5c9-6ca73a615ca1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:44.405766 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57bdcd90-6e63-474c-b5c9-6ca73a615ca1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:44.406548 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57bdcd90-6e63-474c-b5c9-6ca73a615ca1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:44.406985 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57bdcd90-6e63-474c-b5c9-6ca73a615ca1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:44.420889 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a9fc7e9d-52ab-4f1f-a546-6899115ca636 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:44.421529 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-a9fc7e9d-52ab-4f1f-a546-6899115ca636 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:44.428308 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9fc7e9d-52ab-4f1f-a546-6899115ca636 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:44.429081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9fc7e9d-52ab-4f1f-a546-6899115ca636 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:44.430179 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9fc7e9d-52ab-4f1f-a546-6899115ca636 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:44.430618 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9fc7e9d-52ab-4f1f-a546-6899115ca636 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:44.446253 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57bdcd90-6e63-474c-b5c9-6ca73a615ca1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:44.446762 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57bdcd90-6e63-474c-b5c9-6ca73a615ca1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:44.447142 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-57bdcd90-6e63-474c-b5c9-6ca73a615ca1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lazy-loading 'fault' on Instance uuid da275cd5-e209-45c5-a46e-3082d668a6b5 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:49:44.498207 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-57bdcd90-6e63-474c-b5c9-6ca73a615ca1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e714aad25f4fda8acf767ad7e2490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8789771e8a4505866424b6c7748291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:44.506667 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-57bdcd90-6e63-474c-b5c9-6ca73a615ca1 tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 200 len: 1312 microversion: 2.1 time: 0.112138 Aug 03 10:49:44.508222 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 395/772] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:44 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:44.615369 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-a9fc7e9d-52ab-4f1f-a546-6899115ca636 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:44.625127 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-a9fc7e9d-52ab-4f1f-a546-6899115ca636 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1576 microversion: 2.1 time: 0.208540 Aug 03 10:49:44.625915 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 378/773] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:44 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1576 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:49:45.529798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3c023aa7-69f3-4d95-b90e-5efdf40f106b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:45.530411 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3c023aa7-69f3-4d95-b90e-5efdf40f106b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] [instance: da275cd5-e209-45c5-a46e-3082d668a6b5] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:45.537164 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3c023aa7-69f3-4d95-b90e-5efdf40f106b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:45.537652 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3c023aa7-69f3-4d95-b90e-5efdf40f106b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:45.538428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3c023aa7-69f3-4d95-b90e-5efdf40f106b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:45.538864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3c023aa7-69f3-4d95-b90e-5efdf40f106b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:45.553107 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-3c023aa7-69f3-4d95-b90e-5efdf40f106b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] HTTP exception thrown: Instance da275cd5-e209-45c5-a46e-3082d668a6b5 could not be found. Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3c023aa7-69f3-4d95-b90e-5efdf40f106b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Request method failure captured: Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 HTTP/1.1 Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lF2pOWmhCbmjifspfqKpHzAxIhbE2uFuR1reDQeN7S2zka5yP-6of9k_LGD6SROhSzwAA7evRUOk4uaXIt5tYTAzEQECkaYCrzI0Aqtaz-VJZl5OF72sMI3bRVG5PZbcMDIsDqI_MOs7HwjGb9gR7eJuQbd-puQcPhNc0yJtZc7Oks Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: ca8789771e8a4505866424b6c7748291 Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168500966 Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:49:45.555343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:49:45.556907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca8789771e8a4505866424b6c7748291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca8789771e8a4505866424b6c7748291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca8789771e8a4505866424b6c7748291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca8789771e8a4505866424b6c7748291", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:49:45.556907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168500966 Aug 03 10:49:45.556907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: ca8789771e8a4505866424b6c7748291 Aug 03 10:49:45.556907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168500966 Aug 03 10:49:45.556907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-ServerRescueNegativeTestJSON-168500966-project Aug 03 10:49:45.556907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:49:45.556907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:49:45.556907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: a5e714aad25f4fda8acf767ad7e2490b Aug 03 10:49:45.556907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168500966-project Aug 03 10:49:45.556907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:49:45.556907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance da275cd5-e209-45c5-a46e-3082d668a6b5 could not be found. Aug 03 10:49:45.556907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': 'da275cd5-e209-45c5-a46e-3082d668a6b5'} Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da275cd5-e209-45c5-a46e-3082d668a6b5 could not be found. Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:49:45.557798 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da275cd5-e209-45c5-a46e-3082d668a6b5 could not be found. Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da275cd5-e209-45c5-a46e-3082d668a6b5 could not be found. Aug 03 10:49:45.559230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:49:45.560708 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3c023aa7-69f3-4d95-b90e-5efdf40f106b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] Returning 404 to user: Instance da275cd5-e209-45c5-a46e-3082d668a6b5 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:49:45.560708 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3c023aa7-69f3-4d95-b90e-5efdf40f106b tempest-ServerRescueNegativeTestJSON-168500966 tempest-ServerRescueNegativeTestJSON-168500966-project] 10.222.0.47 "GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5" status: 404 len: 111 microversion: 2.1 time: 0.031065 Aug 03 10:49:45.560708 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 396/774] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:45 2022] GET /compute/v2.1/servers/da275cd5-e209-45c5-a46e-3082d668a6b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:49:45.648431 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a9150a8a-e105-43c9-b852-68a82b98923c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:45.649294 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-a9150a8a-e105-43c9-b852-68a82b98923c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:45.655814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9150a8a-e105-43c9-b852-68a82b98923c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:45.656267 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9150a8a-e105-43c9-b852-68a82b98923c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:45.657047 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9150a8a-e105-43c9-b852-68a82b98923c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:45.657505 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a9150a8a-e105-43c9-b852-68a82b98923c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:45.918515 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-a9150a8a-e105-43c9-b852-68a82b98923c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:45.927609 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-a9150a8a-e105-43c9-b852-68a82b98923c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1576 microversion: 2.1 time: 0.283861 Aug 03 10:49:45.928216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 379/775] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:45 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1576 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:46.322793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-76b546ae-5b94-4421-a92f-110225b50b5e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:46.323282 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-76b546ae-5b94-4421-a92f-110225b50b5e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:46.329706 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76b546ae-5b94-4421-a92f-110225b50b5e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:46.330152 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76b546ae-5b94-4421-a92f-110225b50b5e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:46.330923 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76b546ae-5b94-4421-a92f-110225b50b5e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:46.331350 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76b546ae-5b94-4421-a92f-110225b50b5e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:46.356535 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-76b546ae-5b94-4421-a92f-110225b50b5e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/ips" status: 200 len: 146 microversion: 2.1 time: 0.038122 Aug 03 10:49:46.357114 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 397/776] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 3 10:49:46 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:49:46.952332 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-778f8444-6356-4722-b7f4-79fc8955799d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:46.953109 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-778f8444-6356-4722-b7f4-79fc8955799d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:46.959911 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-778f8444-6356-4722-b7f4-79fc8955799d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:46.960362 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-778f8444-6356-4722-b7f4-79fc8955799d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:46.961657 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-778f8444-6356-4722-b7f4-79fc8955799d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:46.962392 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-778f8444-6356-4722-b7f4-79fc8955799d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:47.232069 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-778f8444-6356-4722-b7f4-79fc8955799d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:47.240375 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-778f8444-6356-4722-b7f4-79fc8955799d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1576 microversion: 2.1 time: 0.292047 Aug 03 10:49:47.240982 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 380/777] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:46 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1576 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:47.375058 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fff88981-65c6-4098-8947-ff2d877a70e2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:47.376456 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fff88981-65c6-4098-8947-ff2d877a70e2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:47.384813 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fff88981-65c6-4098-8947-ff2d877a70e2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:47.388581 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fff88981-65c6-4098-8947-ff2d877a70e2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:47.389633 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fff88981-65c6-4098-8947-ff2d877a70e2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:47.390078 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fff88981-65c6-4098-8947-ff2d877a70e2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:47.432502 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fff88981-65c6-4098-8947-ff2d877a70e2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263/ips" status: 200 len: 152 microversion: 2.20 time: 0.175526 Aug 03 10:49:47.433072 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 398/778] 10.222.0.47 () {60 vars in 1289 bytes} [Wed Aug 3 10:49:47 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263/ips => generated 152 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:49:47.771511 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-7662ab76-df4a-47c7-8dcf-6717ccef26e6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fdb3893-4222-4da1-823c-47d9ff1c428c"}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:47.774060 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-7662ab76-df4a-47c7-8dcf-6717ccef26e6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:47.780654 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7662ab76-df4a-47c7-8dcf-6717ccef26e6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:47.781405 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7662ab76-df4a-47c7-8dcf-6717ccef26e6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:47.782400 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7662ab76-df4a-47c7-8dcf-6717ccef26e6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:47.783002 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7662ab76-df4a-47c7-8dcf-6717ccef26e6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:48.086834 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-7662ab76-df4a-47c7-8dcf-6717ccef26e6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "POST /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319086 Aug 03 10:49:48.094204 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 381/779] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 3 10:49:47 2022] POST /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:49:48.264414 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6e0b552f-8e14-41cc-a85c-966f7aa4e389 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:48.265335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6e0b552f-8e14-41cc-a85c-966f7aa4e389 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:48.274710 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6e0b552f-8e14-41cc-a85c-966f7aa4e389 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:48.275303 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6e0b552f-8e14-41cc-a85c-966f7aa4e389 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:48.276190 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6e0b552f-8e14-41cc-a85c-966f7aa4e389 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:48.276841 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6e0b552f-8e14-41cc-a85c-966f7aa4e389 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:48.554108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6e0b552f-8e14-41cc-a85c-966f7aa4e389 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:48.563160 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6e0b552f-8e14-41cc-a85c-966f7aa4e389 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1576 microversion: 2.1 time: 0.302688 Aug 03 10:49:48.563786 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 399/780] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:48 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1576 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:49:49.410970 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-11e93806-7dbe-4aaa-ac5d-8a60a7562895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:49.411658 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-11e93806-7dbe-4aaa-ac5d-8a60a7562895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:49.421217 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-11e93806-7dbe-4aaa-ac5d-8a60a7562895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:49.421443 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-11e93806-7dbe-4aaa-ac5d-8a60a7562895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:49.422374 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-11e93806-7dbe-4aaa-ac5d-8a60a7562895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:49.422942 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-11e93806-7dbe-4aaa-ac5d-8a60a7562895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:49.452557 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-11e93806-7dbe-4aaa-ac5d-8a60a7562895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lazy-loading 'flavor' on Instance uuid 99cbe8d4-0681-4b94-a774-1f0067f69263 {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:49:49.593567 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c7e8aafa-6cd6-4a6f-82bc-032ab2e9a10c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:49.595168 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c7e8aafa-6cd6-4a6f-82bc-032ab2e9a10c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:49.607417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7e8aafa-6cd6-4a6f-82bc-032ab2e9a10c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:49.608222 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7e8aafa-6cd6-4a6f-82bc-032ab2e9a10c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:49.610213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7e8aafa-6cd6-4a6f-82bc-032ab2e9a10c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:49.610959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7e8aafa-6cd6-4a6f-82bc-032ab2e9a10c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:49.710301 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-11e93806-7dbe-4aaa-ac5d-8a60a7562895 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "POST /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263/action" status: 202 len: 0 microversion: 2.20 time: 0.303787 Aug 03 10:49:49.711157 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 382/781] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Aug 3 10:49:49 2022] POST /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 03 10:49:49.722916 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5861c034-fed6-4d41-9664-1bce4040c91b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:49.724494 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-5861c034-fed6-4d41-9664-1bce4040c91b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:49.734640 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5861c034-fed6-4d41-9664-1bce4040c91b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:49.735390 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5861c034-fed6-4d41-9664-1bce4040c91b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:49.736350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5861c034-fed6-4d41-9664-1bce4040c91b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:49.736831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5861c034-fed6-4d41-9664-1bce4040c91b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:49.931894 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c7e8aafa-6cd6-4a6f-82bc-032ab2e9a10c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:49.942818 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c7e8aafa-6cd6-4a6f-82bc-032ab2e9a10c tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1576 microversion: 2.1 time: 0.357850 Aug 03 10:49:49.944715 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 400/782] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:49 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1576 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:49:49.985886 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5861c034-fed6-4d41-9664-1bce4040c91b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:50.010397 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5861c034-fed6-4d41-9664-1bce4040c91b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:50.013453 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5861c034-fed6-4d41-9664-1bce4040c91b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:50.015984 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5861c034-fed6-4d41-9664-1bce4040c91b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1722 microversion: 2.20 time: 0.297956 Aug 03 10:49:50.017219 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 383/783] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:49:49 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:49:50.965764 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1492f2c7-1f2a-4fb1-aae8-4825788cded2 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:50.966491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1492f2c7-1f2a-4fb1-aae8-4825788cded2 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:50.973701 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1492f2c7-1f2a-4fb1-aae8-4825788cded2 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:50.974149 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1492f2c7-1f2a-4fb1-aae8-4825788cded2 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:50.975476 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1492f2c7-1f2a-4fb1-aae8-4825788cded2 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:50.975913 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1492f2c7-1f2a-4fb1-aae8-4825788cded2 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:50.992746 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:49:51.041898 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6876f2f8-d609-402f-b54e-5a09e78a85a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:51.043725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6876f2f8-d609-402f-b54e-5a09e78a85a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:51.050800 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=3 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:49:51.057211 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6876f2f8-d609-402f-b54e-5a09e78a85a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:51.057920 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6876f2f8-d609-402f-b54e-5a09e78a85a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:51.059387 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6876f2f8-d609-402f-b54e-5a09e78a85a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:51.059876 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6876f2f8-d609-402f-b54e-5a09e78a85a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:51.067442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:49:51.203550 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1492f2c7-1f2a-4fb1-aae8-4825788cded2 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:51.212906 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1492f2c7-1f2a-4fb1-aae8-4825788cded2 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1576 microversion: 2.1 time: 0.251490 Aug 03 10:49:51.213759 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 401/784] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:50 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1576 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:51.281412 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-6876f2f8-d609-402f-b54e-5a09e78a85a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:51.290346 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-6876f2f8-d609-402f-b54e-5a09e78a85a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:51.292212 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-6876f2f8-d609-402f-b54e-5a09e78a85a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:51.293484 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-6876f2f8-d609-402f-b54e-5a09e78a85a7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1722 microversion: 2.20 time: 0.257062 Aug 03 10:49:51.294240 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 384/785] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:49:51 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:49:51.723879 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-1d226e35-a4a8-45b1-93b0-ed6bf06749d9 req-6a698e70-3c08-4edf-b958-69912cf76a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e1399d5-9f28-4b92-a752-a233a1652022", "name": "network-vif-plugged", "status": "completed", "tag": "ea1ca950-d067-4257-9371-6667208eda63"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:51.741420 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-1d226e35-a4a8-45b1-93b0-ed6bf06749d9 req-6a698e70-3c08-4edf-b958-69912cf76a25 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:51.742173 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-1d226e35-a4a8-45b1-93b0-ed6bf06749d9 req-6a698e70-3c08-4edf-b958-69912cf76a25 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:51.755837 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-1d226e35-a4a8-45b1-93b0-ed6bf06749d9 req-6a698e70-3c08-4edf-b958-69912cf76a25 service nova] Creating event network-vif-plugged:ea1ca950-d067-4257-9371-6667208eda63 for instance 7e1399d5-9f28-4b92-a752-a233a1652022 on hv-cinder-85083 Aug 03 10:49:51.761510 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-1d226e35-a4a8-45b1-93b0-ed6bf06749d9 req-6a698e70-3c08-4edf-b958-69912cf76a25 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210201 Aug 03 10:49:51.762393 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 402/786] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:49:52.236221 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-32a3c6a7-8a07-44ef-b2ba-4514041fc56f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:52.236840 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-32a3c6a7-8a07-44ef-b2ba-4514041fc56f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:52.244140 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-32a3c6a7-8a07-44ef-b2ba-4514041fc56f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:52.244595 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-32a3c6a7-8a07-44ef-b2ba-4514041fc56f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:52.245367 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-32a3c6a7-8a07-44ef-b2ba-4514041fc56f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:52.245841 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-32a3c6a7-8a07-44ef-b2ba-4514041fc56f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:52.336359 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-783c5f77-927b-41a7-b8d2-4f656ff16050 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:52.337055 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-783c5f77-927b-41a7-b8d2-4f656ff16050 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:52.343799 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-783c5f77-927b-41a7-b8d2-4f656ff16050 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:52.344245 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-783c5f77-927b-41a7-b8d2-4f656ff16050 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:52.345221 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-783c5f77-927b-41a7-b8d2-4f656ff16050 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:52.345726 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-783c5f77-927b-41a7-b8d2-4f656ff16050 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:52.381669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-32a3c6a7-8a07-44ef-b2ba-4514041fc56f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:52.389969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-32a3c6a7-8a07-44ef-b2ba-4514041fc56f tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1576 microversion: 2.1 time: 0.158566 Aug 03 10:49:52.390558 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 385/787] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:52 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:52.481232 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-783c5f77-927b-41a7-b8d2-4f656ff16050 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:52.489568 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-783c5f77-927b-41a7-b8d2-4f656ff16050 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:52.491120 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-783c5f77-927b-41a7-b8d2-4f656ff16050 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:52.492317 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-783c5f77-927b-41a7-b8d2-4f656ff16050 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1722 microversion: 2.20 time: 0.161624 Aug 03 10:49:52.492872 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 403/788] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:49:52 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:49:53.416912 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-bf085267-be07-4a08-b807-5309bb5f26ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:53.417711 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-bf085267-be07-4a08-b807-5309bb5f26ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:53.425331 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bf085267-be07-4a08-b807-5309bb5f26ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:53.426048 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bf085267-be07-4a08-b807-5309bb5f26ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:53.426831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bf085267-be07-4a08-b807-5309bb5f26ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:53.427280 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bf085267-be07-4a08-b807-5309bb5f26ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:53.515918 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-04f46cf9-831e-4635-a0d1-b3415c66a6fb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:53.517145 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-04f46cf9-831e-4635-a0d1-b3415c66a6fb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:53.529334 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-04f46cf9-831e-4635-a0d1-b3415c66a6fb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:53.529825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-04f46cf9-831e-4635-a0d1-b3415c66a6fb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:53.530682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-04f46cf9-831e-4635-a0d1-b3415c66a6fb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:53.531048 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-04f46cf9-831e-4635-a0d1-b3415c66a6fb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:53.654598 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-bf085267-be07-4a08-b807-5309bb5f26ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:53.662657 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-bf085267-be07-4a08-b807-5309bb5f26ad tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1563 microversion: 2.1 time: 0.254546 Aug 03 10:49:53.672364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 386/789] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:49:53 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1563 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:49:53.724137 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-04f46cf9-831e-4635-a0d1-b3415c66a6fb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:53.732723 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-04f46cf9-831e-4635-a0d1-b3415c66a6fb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:53.734249 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-04f46cf9-831e-4635-a0d1-b3415c66a6fb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:53.735400 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-04f46cf9-831e-4635-a0d1-b3415c66a6fb tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1722 microversion: 2.20 time: 0.223780 Aug 03 10:49:53.735978 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 404/790] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:49:53 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:49:54.675230 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-61e8882e-d643-492c-a026-7615e282e4bd tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:54.677789 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-61e8882e-d643-492c-a026-7615e282e4bd tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:54.684440 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-61e8882e-d643-492c-a026-7615e282e4bd tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:54.684891 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-61e8882e-d643-492c-a026-7615e282e4bd tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:54.685804 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-61e8882e-d643-492c-a026-7615e282e4bd tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:54.686227 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-61e8882e-d643-492c-a026-7615e282e4bd tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:54.719700 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-61e8882e-d643-492c-a026-7615e282e4bd tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048783 Aug 03 10:49:54.720268 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 387/791] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:49:54 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:49:54.731577 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b8006f07-0f80-421a-b6d0-a0a9a2e644e8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:54.732140 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b8006f07-0f80-421a-b6d0-a0a9a2e644e8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:54.738814 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b8006f07-0f80-421a-b6d0-a0a9a2e644e8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:54.739263 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b8006f07-0f80-421a-b6d0-a0a9a2e644e8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:54.740053 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b8006f07-0f80-421a-b6d0-a0a9a2e644e8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:54.740508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b8006f07-0f80-421a-b6d0-a0a9a2e644e8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:54.759443 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e272e8fc-eb1d-45f7-91b3-40062676994c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:54.760039 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e272e8fc-eb1d-45f7-91b3-40062676994c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:54.766869 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e272e8fc-eb1d-45f7-91b3-40062676994c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:54.767530 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e272e8fc-eb1d-45f7-91b3-40062676994c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:54.768295 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e272e8fc-eb1d-45f7-91b3-40062676994c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:54.768909 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e272e8fc-eb1d-45f7-91b3-40062676994c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:54.771684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b8006f07-0f80-421a-b6d0-a0a9a2e644e8 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments/5fdb3893-4222-4da1-823c-47d9ff1c428c" status: 200 len: 194 microversion: 2.1 time: 0.044012 Aug 03 10:49:54.772293 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 405/792] 10.222.0.47 () {58 vars in 1413 bytes} [Wed Aug 3 10:49:54 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments/5fdb3893-4222-4da1-823c-47d9ff1c428c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:49:54.933624 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e272e8fc-eb1d-45f7-91b3-40062676994c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:54.941675 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e272e8fc-eb1d-45f7-91b3-40062676994c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:54.943190 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e272e8fc-eb1d-45f7-91b3-40062676994c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:54.944408 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e272e8fc-eb1d-45f7-91b3-40062676994c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1722 microversion: 2.20 time: 0.189511 Aug 03 10:49:54.945512 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 388/793] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:49:54 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:49:55.969012 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ba0c9d97-9435-41da-871a-41fd4ec953ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:55.969652 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ba0c9d97-9435-41da-871a-41fd4ec953ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:55.976253 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba0c9d97-9435-41da-871a-41fd4ec953ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:55.976704 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba0c9d97-9435-41da-871a-41fd4ec953ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:55.977498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba0c9d97-9435-41da-871a-41fd4ec953ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:55.978508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba0c9d97-9435-41da-871a-41fd4ec953ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:56.121289 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ba0c9d97-9435-41da-871a-41fd4ec953ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:56.130427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ba0c9d97-9435-41da-871a-41fd4ec953ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:56.131994 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ba0c9d97-9435-41da-871a-41fd4ec953ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:56.133165 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ba0c9d97-9435-41da-871a-41fd4ec953ad tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1722 microversion: 2.20 time: 0.168261 Aug 03 10:49:56.133767 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 406/794] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:49:55 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:49:57.156734 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-8e470ae6-e1be-4a4b-9636-7de286bfa855 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:57.157367 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-8e470ae6-e1be-4a4b-9636-7de286bfa855 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:57.164273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8e470ae6-e1be-4a4b-9636-7de286bfa855 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:57.164724 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8e470ae6-e1be-4a4b-9636-7de286bfa855 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:57.165533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8e470ae6-e1be-4a4b-9636-7de286bfa855 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:57.165953 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8e470ae6-e1be-4a4b-9636-7de286bfa855 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:57.302849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-8e470ae6-e1be-4a4b-9636-7de286bfa855 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:57.312359 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-8e470ae6-e1be-4a4b-9636-7de286bfa855 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:57.314101 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-8e470ae6-e1be-4a4b-9636-7de286bfa855 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:57.315255 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-8e470ae6-e1be-4a4b-9636-7de286bfa855 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1722 microversion: 2.20 time: 0.162503 Aug 03 10:49:57.315808 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 389/795] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:49:57 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:49:58.339642 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2e3d2fe0-ee4f-4cd6-b571-77458909f7f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:58.340401 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2e3d2fe0-ee4f-4cd6-b571-77458909f7f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:58.347077 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2e3d2fe0-ee4f-4cd6-b571-77458909f7f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:58.347515 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2e3d2fe0-ee4f-4cd6-b571-77458909f7f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:58.348359 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2e3d2fe0-ee4f-4cd6-b571-77458909f7f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:58.348908 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2e3d2fe0-ee4f-4cd6-b571-77458909f7f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:58.498161 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2e3d2fe0-ee4f-4cd6-b571-77458909f7f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:58.506841 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2e3d2fe0-ee4f-4cd6-b571-77458909f7f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:58.508346 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2e3d2fe0-ee4f-4cd6-b571-77458909f7f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:58.509661 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2e3d2fe0-ee4f-4cd6-b571-77458909f7f9 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1722 microversion: 2.20 time: 0.173894 Aug 03 10:49:58.510193 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 407/796] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:49:58 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:49:59.452000 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a56b44bd-9486-459c-8eec-fb91d80bb0ed tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e514c642-52d8-4353-80a4-13413661adde"}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:49:59.454338 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-a56b44bd-9486-459c-8eec-fb91d80bb0ed tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:59.460905 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a56b44bd-9486-459c-8eec-fb91d80bb0ed tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:59.461355 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a56b44bd-9486-459c-8eec-fb91d80bb0ed tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:59.462703 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a56b44bd-9486-459c-8eec-fb91d80bb0ed tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:59.463138 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a56b44bd-9486-459c-8eec-fb91d80bb0ed tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:59.532553 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a46fc710-351d-4022-8083-4cffe01a8c42 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:49:59.533207 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a46fc710-351d-4022-8083-4cffe01a8c42 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:49:59.539656 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a46fc710-351d-4022-8083-4cffe01a8c42 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:59.540177 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a46fc710-351d-4022-8083-4cffe01a8c42 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:59.540949 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a46fc710-351d-4022-8083-4cffe01a8c42 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:49:59.541399 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a46fc710-351d-4022-8083-4cffe01a8c42 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:49:59.687758 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a46fc710-351d-4022-8083-4cffe01a8c42 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:59.697010 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a46fc710-351d-4022-8083-4cffe01a8c42 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:59.698613 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a46fc710-351d-4022-8083-4cffe01a8c42 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:49:59.699782 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a46fc710-351d-4022-8083-4cffe01a8c42 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1722 microversion: 2.20 time: 0.171105 Aug 03 10:49:59.713695 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 408/797] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:49:59 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:49:59.728802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-a56b44bd-9486-459c-8eec-fb91d80bb0ed tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "POST /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272754 Aug 03 10:49:59.729527 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 390/798] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 3 10:49:59 2022] POST /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:00.723464 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2bf7e30a-a10b-4dd4-9e1e-fca1b726b45e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:00.724065 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2bf7e30a-a10b-4dd4-9e1e-fca1b726b45e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:00.730551 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2bf7e30a-a10b-4dd4-9e1e-fca1b726b45e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:00.730984 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2bf7e30a-a10b-4dd4-9e1e-fca1b726b45e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:00.731741 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2bf7e30a-a10b-4dd4-9e1e-fca1b726b45e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:00.732173 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2bf7e30a-a10b-4dd4-9e1e-fca1b726b45e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:00.861405 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2bf7e30a-a10b-4dd4-9e1e-fca1b726b45e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:00.869545 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2bf7e30a-a10b-4dd4-9e1e-fca1b726b45e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:00.871038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2bf7e30a-a10b-4dd4-9e1e-fca1b726b45e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:00.872177 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2bf7e30a-a10b-4dd4-9e1e-fca1b726b45e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1722 microversion: 2.20 time: 0.152684 Aug 03 10:50:00.872723 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 409/799] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:00 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:01.898546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1146126e-519f-47f8-98a1-67e824f3ddd5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:01.899331 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-1146126e-519f-47f8-98a1-67e824f3ddd5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:01.906856 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1146126e-519f-47f8-98a1-67e824f3ddd5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:01.907381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1146126e-519f-47f8-98a1-67e824f3ddd5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:01.908548 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1146126e-519f-47f8-98a1-67e824f3ddd5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:01.909582 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1146126e-519f-47f8-98a1-67e824f3ddd5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:02.059920 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1146126e-519f-47f8-98a1-67e824f3ddd5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:02.068595 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1146126e-519f-47f8-98a1-67e824f3ddd5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:02.070499 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1146126e-519f-47f8-98a1-67e824f3ddd5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:02.071963 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1146126e-519f-47f8-98a1-67e824f3ddd5 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1722 microversion: 2.20 time: 0.178454 Aug 03 10:50:02.072517 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 391/800] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:01 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:03.094727 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ed7a6499-de7c-4aac-a402-e44e5af4e29f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:03.095339 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ed7a6499-de7c-4aac-a402-e44e5af4e29f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:03.101982 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ed7a6499-de7c-4aac-a402-e44e5af4e29f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:03.102445 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ed7a6499-de7c-4aac-a402-e44e5af4e29f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:03.103197 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ed7a6499-de7c-4aac-a402-e44e5af4e29f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:03.103630 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ed7a6499-de7c-4aac-a402-e44e5af4e29f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:03.236232 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ed7a6499-de7c-4aac-a402-e44e5af4e29f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:03.245169 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ed7a6499-de7c-4aac-a402-e44e5af4e29f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:03.246826 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ed7a6499-de7c-4aac-a402-e44e5af4e29f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:03.247973 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ed7a6499-de7c-4aac-a402-e44e5af4e29f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1722 microversion: 2.20 time: 0.157138 Aug 03 10:50:03.248520 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 410/801] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:03 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:04.271681 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-024f442c-53e1-4a4b-80b6-56e5ab9133bc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:04.272422 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-024f442c-53e1-4a4b-80b6-56e5ab9133bc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:04.279123 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-024f442c-53e1-4a4b-80b6-56e5ab9133bc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:04.279660 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-024f442c-53e1-4a4b-80b6-56e5ab9133bc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:04.280506 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-024f442c-53e1-4a4b-80b6-56e5ab9133bc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:04.281088 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-024f442c-53e1-4a4b-80b6-56e5ab9133bc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:04.423615 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-024f442c-53e1-4a4b-80b6-56e5ab9133bc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:04.432347 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-024f442c-53e1-4a4b-80b6-56e5ab9133bc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:04.433743 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-024f442c-53e1-4a4b-80b6-56e5ab9133bc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:04.434910 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-024f442c-53e1-4a4b-80b6-56e5ab9133bc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1722 microversion: 2.20 time: 0.167135 Aug 03 10:50:04.435470 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 392/802] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:04 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:05.458170 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a552419a-c749-40ec-8cf0-efaa9c2db2cf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:05.458776 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a552419a-c749-40ec-8cf0-efaa9c2db2cf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:05.482304 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a552419a-c749-40ec-8cf0-efaa9c2db2cf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:05.482781 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a552419a-c749-40ec-8cf0-efaa9c2db2cf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:05.483577 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a552419a-c749-40ec-8cf0-efaa9c2db2cf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:05.484050 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a552419a-c749-40ec-8cf0-efaa9c2db2cf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:05.625027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a552419a-c749-40ec-8cf0-efaa9c2db2cf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:05.633696 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a552419a-c749-40ec-8cf0-efaa9c2db2cf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:05.635300 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a552419a-c749-40ec-8cf0-efaa9c2db2cf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:05.636549 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a552419a-c749-40ec-8cf0-efaa9c2db2cf tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1743 microversion: 2.20 time: 0.182584 Aug 03 10:50:05.637192 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 411/803] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:05 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1743 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:06.664024 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5bdd2e77-ab74-4b8e-8771-bc5c5c9fac99 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:06.664793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-5bdd2e77-ab74-4b8e-8771-bc5c5c9fac99 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:06.674434 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5bdd2e77-ab74-4b8e-8771-bc5c5c9fac99 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:06.674883 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5bdd2e77-ab74-4b8e-8771-bc5c5c9fac99 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:06.675664 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5bdd2e77-ab74-4b8e-8771-bc5c5c9fac99 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:06.676100 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5bdd2e77-ab74-4b8e-8771-bc5c5c9fac99 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:06.827987 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5bdd2e77-ab74-4b8e-8771-bc5c5c9fac99 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:06.836030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5bdd2e77-ab74-4b8e-8771-bc5c5c9fac99 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:06.838112 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5bdd2e77-ab74-4b8e-8771-bc5c5c9fac99 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:06.839269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5bdd2e77-ab74-4b8e-8771-bc5c5c9fac99 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1743 microversion: 2.20 time: 0.181715 Aug 03 10:50:06.839819 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 393/804] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:06 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1743 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:07.284044 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d249422c-47fe-490f-8875-183ffe33e46b tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:07.287685 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d249422c-47fe-490f-8875-183ffe33e46b tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:07.295006 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d249422c-47fe-490f-8875-183ffe33e46b tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:07.295453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d249422c-47fe-490f-8875-183ffe33e46b tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:07.296431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d249422c-47fe-490f-8875-183ffe33e46b tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:07.297034 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d249422c-47fe-490f-8875-183ffe33e46b tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:07.337498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d249422c-47fe-490f-8875-183ffe33e46b tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057218 Aug 03 10:50:07.338200 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 412/805] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:50:07 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:07.492023 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-48bd5180-5bd3-45f7-b486-3cc5d03d0620 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:07.493762 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-48bd5180-5bd3-45f7-b486-3cc5d03d0620 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:07.500429 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-48bd5180-5bd3-45f7-b486-3cc5d03d0620 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:07.501849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-48bd5180-5bd3-45f7-b486-3cc5d03d0620 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:07.504620 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-48bd5180-5bd3-45f7-b486-3cc5d03d0620 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:07.505672 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-48bd5180-5bd3-45f7-b486-3cc5d03d0620 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:07.546546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-48bd5180-5bd3-45f7-b486-3cc5d03d0620 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments/5fdb3893-4222-4da1-823c-47d9ff1c428c" status: 200 len: 194 microversion: 2.1 time: 0.061676 Aug 03 10:50:07.547287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 394/806] 10.222.0.47 () {58 vars in 1413 bytes} [Wed Aug 3 10:50:07 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments/5fdb3893-4222-4da1-823c-47d9ff1c428c => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:07.559585 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e8ec21cd-0c6a-4d6d-b870-908d087e1b2e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:07.560263 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e8ec21cd-0c6a-4d6d-b870-908d087e1b2e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:07.566956 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8ec21cd-0c6a-4d6d-b870-908d087e1b2e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:07.570067 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8ec21cd-0c6a-4d6d-b870-908d087e1b2e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:07.570886 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8ec21cd-0c6a-4d6d-b870-908d087e1b2e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:07.571373 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8ec21cd-0c6a-4d6d-b870-908d087e1b2e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:07.691019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-e8ec21cd-0c6a-4d6d-b870-908d087e1b2e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lazy-loading 'services' on Instance uuid 310651c9-a8fa-4169-950a-581cfdedf786 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:50:07.814089 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e8ec21cd-0c6a-4d6d-b870-908d087e1b2e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "DELETE /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments/5fdb3893-4222-4da1-823c-47d9ff1c428c" status: 202 len: 0 microversion: 2.1 time: 0.256413 Aug 03 10:50:07.814089 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 413/807] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 3 10:50:07 2022] DELETE /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments/5fdb3893-4222-4da1-823c-47d9ff1c428c => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:50:07.867940 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-48e30d79-0bfd-4b4f-b77f-78ef6df1ed2f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:07.869119 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-48e30d79-0bfd-4b4f-b77f-78ef6df1ed2f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:07.885867 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-48e30d79-0bfd-4b4f-b77f-78ef6df1ed2f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:07.886895 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-48e30d79-0bfd-4b4f-b77f-78ef6df1ed2f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:07.892273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-48e30d79-0bfd-4b4f-b77f-78ef6df1ed2f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:07.892738 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-48e30d79-0bfd-4b4f-b77f-78ef6df1ed2f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:08.072850 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-48e30d79-0bfd-4b4f-b77f-78ef6df1ed2f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:08.082090 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-48e30d79-0bfd-4b4f-b77f-78ef6df1ed2f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:08.083719 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-48e30d79-0bfd-4b4f-b77f-78ef6df1ed2f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:08.085653 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-48e30d79-0bfd-4b4f-b77f-78ef6df1ed2f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1738 microversion: 2.20 time: 0.226284 Aug 03 10:50:08.086352 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 395/808] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:07 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:09.110013 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-69ba81fd-b661-44d5-81ee-aeee2928aac3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:09.111298 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-69ba81fd-b661-44d5-81ee-aeee2928aac3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:09.123212 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-69ba81fd-b661-44d5-81ee-aeee2928aac3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:09.123653 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-69ba81fd-b661-44d5-81ee-aeee2928aac3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:09.124458 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-69ba81fd-b661-44d5-81ee-aeee2928aac3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:09.124888 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-69ba81fd-b661-44d5-81ee-aeee2928aac3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:09.279106 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-69ba81fd-b661-44d5-81ee-aeee2928aac3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:09.289417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-69ba81fd-b661-44d5-81ee-aeee2928aac3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:09.291214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-69ba81fd-b661-44d5-81ee-aeee2928aac3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:09.292080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-673dcf9c-14f4-4e39-857c-6f1420704898 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:09.292528 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-69ba81fd-b661-44d5-81ee-aeee2928aac3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1738 microversion: 2.20 time: 0.187395 Aug 03 10:50:09.292624 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-673dcf9c-14f4-4e39-857c-6f1420704898 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:09.299364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-673dcf9c-14f4-4e39-857c-6f1420704898 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:09.299807 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-673dcf9c-14f4-4e39-857c-6f1420704898 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:09.300584 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-673dcf9c-14f4-4e39-857c-6f1420704898 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:09.301213 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-673dcf9c-14f4-4e39-857c-6f1420704898 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:09.307005 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 414/809] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:09 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:09.335544 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-673dcf9c-14f4-4e39-857c-6f1420704898 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90/ips" status: 200 len: 150 microversion: 2.1 time: 0.047196 Aug 03 10:50:09.339617 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 396/810] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 3 10:50:09 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:09.656370 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-7192e59b-ab9a-4c69-827a-d3cfd40fe1a9 req-7b9672d0-a3cd-4d31-bfe0-a49f3bafa211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cbe8d4-0681-4b94-a774-1f0067f69263", "name": "network-vif-plugged", "status": "completed", "tag": "5c7bb60f-6fc3-4d3d-bda1-d77d9a5e91fb"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:50:09.677903 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-7192e59b-ab9a-4c69-827a-d3cfd40fe1a9 req-7b9672d0-a3cd-4d31-bfe0-a49f3bafa211 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:09.678385 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-7192e59b-ab9a-4c69-827a-d3cfd40fe1a9 req-7b9672d0-a3cd-4d31-bfe0-a49f3bafa211 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:09.727230 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-7192e59b-ab9a-4c69-827a-d3cfd40fe1a9 req-7b9672d0-a3cd-4d31-bfe0-a49f3bafa211 service nova] Creating event network-vif-plugged:5c7bb60f-6fc3-4d3d-bda1-d77d9a5e91fb for instance 99cbe8d4-0681-4b94-a774-1f0067f69263 on hv-cinder-85083 Aug 03 10:50:09.757943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-7192e59b-ab9a-4c69-827a-d3cfd40fe1a9 req-7b9672d0-a3cd-4d31-bfe0-a49f3bafa211 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106300 Aug 03 10:50:09.760032 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 415/811] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:10.083927 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b345a325-45c2-48c2-8afd-704d112eca9a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:10.084882 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b345a325-45c2-48c2-8afd-704d112eca9a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:10.093989 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b345a325-45c2-48c2-8afd-704d112eca9a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:10.094778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b345a325-45c2-48c2-8afd-704d112eca9a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:10.095801 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b345a325-45c2-48c2-8afd-704d112eca9a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:10.096450 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b345a325-45c2-48c2-8afd-704d112eca9a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:10.131822 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b345a325-45c2-48c2-8afd-704d112eca9a tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments/e514c642-52d8-4353-80a4-13413661adde" status: 200 len: 194 microversion: 2.1 time: 0.051902 Aug 03 10:50:10.132437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 397/812] 10.222.0.47 () {58 vars in 1413 bytes} [Wed Aug 3 10:50:10 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments/e514c642-52d8-4353-80a4-13413661adde => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:10.145151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3ad6bdc9-7a03-49f3-ad20-1cbc8ea83a0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:10.150697 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3ad6bdc9-7a03-49f3-ad20-1cbc8ea83a0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:10.158308 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3ad6bdc9-7a03-49f3-ad20-1cbc8ea83a0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:10.158769 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3ad6bdc9-7a03-49f3-ad20-1cbc8ea83a0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:10.159554 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3ad6bdc9-7a03-49f3-ad20-1cbc8ea83a0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:10.159976 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3ad6bdc9-7a03-49f3-ad20-1cbc8ea83a0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:10.269172 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-3ad6bdc9-7a03-49f3-ad20-1cbc8ea83a0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lazy-loading 'services' on Instance uuid 310651c9-a8fa-4169-950a-581cfdedf786 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:50:10.321605 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d39f53b8-ad46-4e40-b775-afa23104475f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:10.323096 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d39f53b8-ad46-4e40-b775-afa23104475f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:10.336237 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d39f53b8-ad46-4e40-b775-afa23104475f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:10.337592 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d39f53b8-ad46-4e40-b775-afa23104475f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:10.339625 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d39f53b8-ad46-4e40-b775-afa23104475f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:10.341662 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d39f53b8-ad46-4e40-b775-afa23104475f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:10.363156 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3ad6bdc9-7a03-49f3-ad20-1cbc8ea83a0e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "DELETE /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments/e514c642-52d8-4353-80a4-13413661adde" status: 202 len: 0 microversion: 2.1 time: 0.222748 Aug 03 10:50:10.367727 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 416/813] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 3 10:50:10 2022] DELETE /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments/e514c642-52d8-4353-80a4-13413661adde => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:50:10.603712 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d39f53b8-ad46-4e40-b775-afa23104475f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:10.616365 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d39f53b8-ad46-4e40-b775-afa23104475f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:10.618548 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d39f53b8-ad46-4e40-b775-afa23104475f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:10.619955 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d39f53b8-ad46-4e40-b775-afa23104475f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1738 microversion: 2.20 time: 0.305374 Aug 03 10:50:10.620707 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 398/814] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:10 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:50:10.894700 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d7a81e5d-c6da-4404-a784-e479bfb9e46d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "045e1783-75e3-450f-99aa-54ba8945f0e0"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:50:10.897792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d7a81e5d-c6da-4404-a784-e479bfb9e46d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:10.904478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d7a81e5d-c6da-4404-a784-e479bfb9e46d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:10.905419 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d7a81e5d-c6da-4404-a784-e479bfb9e46d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:10.906224 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d7a81e5d-c6da-4404-a784-e479bfb9e46d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:10.906819 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d7a81e5d-c6da-4404-a784-e479bfb9e46d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:11.079290 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:50:11.245996 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d7a81e5d-c6da-4404-a784-e479bfb9e46d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "POST /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.355558 Aug 03 10:50:11.247490 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 417/815] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 3 10:50:10 2022] POST /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:11.609098 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-8773dacf-d88f-4c77-b78b-d98d32daeac5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:11.612216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-8773dacf-d88f-4c77-b78b-d98d32daeac5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:11.622051 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8773dacf-d88f-4c77-b78b-d98d32daeac5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:11.622723 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8773dacf-d88f-4c77-b78b-d98d32daeac5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:11.624270 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8773dacf-d88f-4c77-b78b-d98d32daeac5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:11.624809 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8773dacf-d88f-4c77-b78b-d98d32daeac5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:11.647393 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-78d5040a-044a-4cd9-8eba-e8baa8c45b55 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:11.648191 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-78d5040a-044a-4cd9-8eba-e8baa8c45b55 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:11.656243 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-78d5040a-044a-4cd9-8eba-e8baa8c45b55 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:11.656977 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-78d5040a-044a-4cd9-8eba-e8baa8c45b55 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:11.657818 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-78d5040a-044a-4cd9-8eba-e8baa8c45b55 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:11.658255 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-78d5040a-044a-4cd9-8eba-e8baa8c45b55 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:11.667529 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:50:11.678493 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-8773dacf-d88f-4c77-b78b-d98d32daeac5 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074449 Aug 03 10:50:11.679490 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 399/816] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:50:11 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 10:50:11.851926 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ab8e1a7f-278a-4192-af31-2247dad30109 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:11.854758 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-ab8e1a7f-278a-4192-af31-2247dad30109 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:11.862194 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ab8e1a7f-278a-4192-af31-2247dad30109 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:11.862570 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-78d5040a-044a-4cd9-8eba-e8baa8c45b55 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:11.863355 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ab8e1a7f-278a-4192-af31-2247dad30109 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:11.864403 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ab8e1a7f-278a-4192-af31-2247dad30109 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:11.864830 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ab8e1a7f-278a-4192-af31-2247dad30109 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:11.877729 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-78d5040a-044a-4cd9-8eba-e8baa8c45b55 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:11.882077 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-78d5040a-044a-4cd9-8eba-e8baa8c45b55 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:11.883898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-78d5040a-044a-4cd9-8eba-e8baa8c45b55 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1738 microversion: 2.20 time: 0.240790 Aug 03 10:50:11.884876 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 418/817] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:11 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:11.927945 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ab8e1a7f-278a-4192-af31-2247dad30109 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079876 Aug 03 10:50:11.928858 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 400/818] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:50:11 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 10:50:12.019012 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-537daf9a-8d28-401a-b794-c617ac8c3815 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:12.019763 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-537daf9a-8d28-401a-b794-c617ac8c3815 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:12.023590 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=54 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:50:12.031463 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-537daf9a-8d28-401a-b794-c617ac8c3815 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:12.031940 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-537daf9a-8d28-401a-b794-c617ac8c3815 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:12.035139 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-537daf9a-8d28-401a-b794-c617ac8c3815 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:12.036656 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-537daf9a-8d28-401a-b794-c617ac8c3815 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:12.066918 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-537daf9a-8d28-401a-b794-c617ac8c3815 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:50:12.165860 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-537daf9a-8d28-401a-b794-c617ac8c3815 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "DELETE /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 204 len: 0 microversion: 2.1 time: 0.149901 Aug 03 10:50:12.166825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 419/819] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:50:12 2022] DELETE /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:50:12.175323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d127841a-0804-419e-97ba-e81fcc6bc986 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:12.176318 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d127841a-0804-419e-97ba-e81fcc6bc986 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:12.186579 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d127841a-0804-419e-97ba-e81fcc6bc986 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:12.187323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d127841a-0804-419e-97ba-e81fcc6bc986 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:12.188769 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d127841a-0804-419e-97ba-e81fcc6bc986 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:12.189363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d127841a-0804-419e-97ba-e81fcc6bc986 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:12.348920 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d127841a-0804-419e-97ba-e81fcc6bc986 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:12.358661 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d127841a-0804-419e-97ba-e81fcc6bc986 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1671 microversion: 2.1 time: 0.187811 Aug 03 10:50:12.359399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 401/820] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:12 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1671 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:50:12.916264 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0fbb2e3f-5f24-4a6e-ac67-a5ff7761b693 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:12.917079 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0fbb2e3f-5f24-4a6e-ac67-a5ff7761b693 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:12.935449 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0fbb2e3f-5f24-4a6e-ac67-a5ff7761b693 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:12.936202 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0fbb2e3f-5f24-4a6e-ac67-a5ff7761b693 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:12.937020 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0fbb2e3f-5f24-4a6e-ac67-a5ff7761b693 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:12.937738 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0fbb2e3f-5f24-4a6e-ac67-a5ff7761b693 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:13.163961 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0fbb2e3f-5f24-4a6e-ac67-a5ff7761b693 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:13.174478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0fbb2e3f-5f24-4a6e-ac67-a5ff7761b693 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:13.181907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0fbb2e3f-5f24-4a6e-ac67-a5ff7761b693 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:13.183052 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0fbb2e3f-5f24-4a6e-ac67-a5ff7761b693 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1738 microversion: 2.20 time: 0.271595 Aug 03 10:50:13.183620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 420/821] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:12 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:13.385335 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-0d784cae-72a4-48ba-8558-b5ecaa103b6d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:13.387007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-0d784cae-72a4-48ba-8558-b5ecaa103b6d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:13.394347 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0d784cae-72a4-48ba-8558-b5ecaa103b6d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:13.395082 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0d784cae-72a4-48ba-8558-b5ecaa103b6d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:13.399865 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0d784cae-72a4-48ba-8558-b5ecaa103b6d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:13.400606 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-0d784cae-72a4-48ba-8558-b5ecaa103b6d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:13.628428 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-0d784cae-72a4-48ba-8558-b5ecaa103b6d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:13.641701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-0d784cae-72a4-48ba-8558-b5ecaa103b6d tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1671 microversion: 2.1 time: 0.261068 Aug 03 10:50:13.642284 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 402/822] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:13 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1671 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:50:14.213633 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-80bf4a36-ecc2-4732-8e2e-0cb2d1a57653 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:14.215027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-80bf4a36-ecc2-4732-8e2e-0cb2d1a57653 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:14.225721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-80bf4a36-ecc2-4732-8e2e-0cb2d1a57653 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:14.226716 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-80bf4a36-ecc2-4732-8e2e-0cb2d1a57653 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:14.227749 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-80bf4a36-ecc2-4732-8e2e-0cb2d1a57653 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:14.228319 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-80bf4a36-ecc2-4732-8e2e-0cb2d1a57653 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:14.446621 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-80bf4a36-ecc2-4732-8e2e-0cb2d1a57653 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:14.457421 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-80bf4a36-ecc2-4732-8e2e-0cb2d1a57653 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:14.459121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-80bf4a36-ecc2-4732-8e2e-0cb2d1a57653 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:14.461455 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-80bf4a36-ecc2-4732-8e2e-0cb2d1a57653 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1738 microversion: 2.20 time: 0.255189 Aug 03 10:50:14.463076 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 421/823] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:14 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:14.681854 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-452a109e-7f83-4b1b-824c-81f219626ddd tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:14.684130 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-452a109e-7f83-4b1b-824c-81f219626ddd tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:14.693728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-452a109e-7f83-4b1b-824c-81f219626ddd tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:14.694185 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-452a109e-7f83-4b1b-824c-81f219626ddd tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:14.694995 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-452a109e-7f83-4b1b-824c-81f219626ddd tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:14.695437 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-452a109e-7f83-4b1b-824c-81f219626ddd tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:14.896575 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-452a109e-7f83-4b1b-824c-81f219626ddd tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:14.912406 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-452a109e-7f83-4b1b-824c-81f219626ddd tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1671 microversion: 2.1 time: 0.236855 Aug 03 10:50:14.913936 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 403/824] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:14 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1671 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:50:15.455070 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-531cfd4d-4805-4337-8215-5ad61e96b9d2 req-b815a5f0-a039-4e84-ba9a-b1204285a5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310651c9-a8fa-4169-950a-581cfdedf786", "name": "network-vif-deleted", "tag": "dade6b18-ba20-4633-971b-0a3be895b570"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:50:15.467582 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-531cfd4d-4805-4337-8215-5ad61e96b9d2 req-b815a5f0-a039-4e84-ba9a-b1204285a5e1 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:15.468572 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-531cfd4d-4805-4337-8215-5ad61e96b9d2 req-b815a5f0-a039-4e84-ba9a-b1204285a5e1 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:15.482385 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-531cfd4d-4805-4337-8215-5ad61e96b9d2 req-b815a5f0-a039-4e84-ba9a-b1204285a5e1 service nova] Creating event network-vif-deleted:dade6b18-ba20-4633-971b-0a3be895b570 for instance 310651c9-a8fa-4169-950a-581cfdedf786 on hv-cinder-85083 Aug 03 10:50:15.490664 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1fbec145-a0a6-4bc6-a26d-3db432435bff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:15.491735 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-1fbec145-a0a6-4bc6-a26d-3db432435bff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:15.501251 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-531cfd4d-4805-4337-8215-5ad61e96b9d2 req-b815a5f0-a039-4e84-ba9a-b1204285a5e1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049644 Aug 03 10:50:15.503325 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1fbec145-a0a6-4bc6-a26d-3db432435bff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:15.509701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1fbec145-a0a6-4bc6-a26d-3db432435bff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:15.509960 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 422/825] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:50:15.511020 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1fbec145-a0a6-4bc6-a26d-3db432435bff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:15.511689 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1fbec145-a0a6-4bc6-a26d-3db432435bff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:15.752832 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1fbec145-a0a6-4bc6-a26d-3db432435bff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:15.764849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1fbec145-a0a6-4bc6-a26d-3db432435bff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:15.767060 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1fbec145-a0a6-4bc6-a26d-3db432435bff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:15.772805 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1fbec145-a0a6-4bc6-a26d-3db432435bff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1738 microversion: 2.20 time: 0.286708 Aug 03 10:50:15.785507 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 404/826] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:15 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:50:15.973360 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5472463e-5681-495b-a0dc-9f9c83d3ece6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:15.973360 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5472463e-5681-495b-a0dc-9f9c83d3ece6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:16.008248 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5472463e-5681-495b-a0dc-9f9c83d3ece6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:16.009288 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5472463e-5681-495b-a0dc-9f9c83d3ece6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:16.010441 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5472463e-5681-495b-a0dc-9f9c83d3ece6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:16.011987 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5472463e-5681-495b-a0dc-9f9c83d3ece6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:16.069200 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5472463e-5681-495b-a0dc-9f9c83d3ece6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:16.069955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5472463e-5681-495b-a0dc-9f9c83d3ece6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:16.070576 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-5472463e-5681-495b-a0dc-9f9c83d3ece6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lazy-loading 'fault' on Instance uuid 310651c9-a8fa-4169-950a-581cfdedf786 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:50:16.151901 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5472463e-5681-495b-a0dc-9f9c83d3ece6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdb81686d804eb3864b97481643fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfc3e09588c48299fdf5634cda57416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:16.164879 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5472463e-5681-495b-a0dc-9f9c83d3ece6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 200 len: 1325 microversion: 2.1 time: 0.229018 Aug 03 10:50:16.166326 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 423/827] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:15 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 1325 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:50:16.800661 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-dc675fd4-272a-4077-ad38-bae33dc0451c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:16.801273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-dc675fd4-272a-4077-ad38-bae33dc0451c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:16.842976 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dc675fd4-272a-4077-ad38-bae33dc0451c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:16.843427 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dc675fd4-272a-4077-ad38-bae33dc0451c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:16.844226 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dc675fd4-272a-4077-ad38-bae33dc0451c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:16.853983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dc675fd4-272a-4077-ad38-bae33dc0451c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:17.106027 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-dc675fd4-272a-4077-ad38-bae33dc0451c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:17.120927 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-dc675fd4-272a-4077-ad38-bae33dc0451c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:17.122761 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-dc675fd4-272a-4077-ad38-bae33dc0451c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:17.123967 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-dc675fd4-272a-4077-ad38-bae33dc0451c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1738 microversion: 2.20 time: 0.328215 Aug 03 10:50:17.124527 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 405/828] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:16 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1738 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:17.190087 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1b843f26-d2dc-4939-b32d-13efcc01332e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:17.191544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1b843f26-d2dc-4939-b32d-13efcc01332e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:17.214583 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1b843f26-d2dc-4939-b32d-13efcc01332e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:17.216978 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1b843f26-d2dc-4939-b32d-13efcc01332e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:17.218757 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1b843f26-d2dc-4939-b32d-13efcc01332e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:17.219569 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1b843f26-d2dc-4939-b32d-13efcc01332e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:17.249310 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-1b843f26-d2dc-4939-b32d-13efcc01332e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] HTTP exception thrown: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1b843f26-d2dc-4939-b32d-13efcc01332e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Request method failure captured: Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 HTTP/1.1 Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFlk9wh8eaqzNROBPOv3fSdMdFyyqtYZ9fS_bPaYaFaJS1qwgKr00hbr9V0W6FuZEXPDWS6At_QzjJZv1hebwhWzb5poWKR4eQDjjv4q0PPI_fGfW_uk-hd10oRDFAfMJvN19agEHC3T9mWCmrkaxFRSVXnBpJELjSWZBGNirfyI5U Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: bcfc3e09588c48299fdf5634cda57416 Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:50:17.251469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:50:17.253213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bcfc3e09588c48299fdf5634cda57416", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:17.253213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:50:17.253213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: bcfc3e09588c48299fdf5634cda57416 Aug 03 10:50:17.253213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:50:17.253213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeTestJSON-522549250-project Aug 03 10:50:17.253213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:50:17.253213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:50:17.253213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: ebdb81686d804eb3864b97481643fc2b Aug 03 10:50:17.253213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeTestJSON-522549250-project Aug 03 10:50:17.253213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:50:17.253213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. Aug 03 10:50:17.253213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': '310651c9-a8fa-4169-950a-581cfdedf786'} Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:17.254260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. Aug 03 10:50:17.255825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:17.258344 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1b843f26-d2dc-4939-b32d-13efcc01332e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Returning 404 to user: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:17.259987 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1b843f26-d2dc-4939-b32d-13efcc01332e tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 404 len: 111 microversion: 2.1 time: 0.074504 Aug 03 10:50:17.269048 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-029b8015-249c-4921-b419-1065eac3d6cb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '.version_select at 0x7fbd104e3700>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:17.275565 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 424/829] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:17 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:17.294687 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-029b8015-249c-4921-b419-1065eac3d6cb tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-919141693" status: 202 len: 0 microversion: 2.1 time: 0.029287 Aug 03 10:50:17.299155 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 406/830] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Aug 3 10:50:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-919141693 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:50:18.185811 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-42e135c4-c1db-410a-9b0e-efdc9cbad658 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:18.186783 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-42e135c4-c1db-410a-9b0e-efdc9cbad658 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:18.223956 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-42e135c4-c1db-410a-9b0e-efdc9cbad658 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:18.224671 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-42e135c4-c1db-410a-9b0e-efdc9cbad658 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:18.225571 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-42e135c4-c1db-410a-9b0e-efdc9cbad658 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:18.226054 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-42e135c4-c1db-410a-9b0e-efdc9cbad658 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:18.226949 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ab540436-a499-477f-a342-0bc9cc05cf8f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:18.228099 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-ab540436-a499-477f-a342-0bc9cc05cf8f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:18.242834 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ab540436-a499-477f-a342-0bc9cc05cf8f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:18.242834 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ab540436-a499-477f-a342-0bc9cc05cf8f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:18.247471 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ab540436-a499-477f-a342-0bc9cc05cf8f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:18.247948 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ab540436-a499-477f-a342-0bc9cc05cf8f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:18.433681 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-ab540436-a499-477f-a342-0bc9cc05cf8f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lazy-loading 'services' on Instance uuid 53cc123d-d9f0-4035-ad45-42ba2f585c90 {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:50:18.526234 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-42e135c4-c1db-410a-9b0e-efdc9cbad658 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:18.543449 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-42e135c4-c1db-410a-9b0e-efdc9cbad658 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:18.544996 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-42e135c4-c1db-410a-9b0e-efdc9cbad658 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:18.546497 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-42e135c4-c1db-410a-9b0e-efdc9cbad658 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1738 microversion: 2.20 time: 0.395432 Aug 03 10:50:18.561565 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 425/831] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:18 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1738 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:18.573866 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ab540436-a499-477f-a342-0bc9cc05cf8f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "DELETE /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90/os-volume_attachments/045e1783-75e3-450f-99aa-54ba8945f0e0" status: 202 len: 0 microversion: 2.1 time: 0.350718 Aug 03 10:50:18.575238 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 407/832] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 3 10:50:18 2022] DELETE /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90/os-volume_attachments/045e1783-75e3-450f-99aa-54ba8945f0e0 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:50:18.588340 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e6243103-1fc3-44ce-8365-697938257105 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:18.591428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e6243103-1fc3-44ce-8365-697938257105 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:18.605524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e6243103-1fc3-44ce-8365-697938257105 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:18.606582 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e6243103-1fc3-44ce-8365-697938257105 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:18.608414 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e6243103-1fc3-44ce-8365-697938257105 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:18.609034 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e6243103-1fc3-44ce-8365-697938257105 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:18.671010 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e6243103-1fc3-44ce-8365-697938257105 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089047 Aug 03 10:50:18.673499 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 426/833] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:50:18 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:19.572294 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d0a334a1-b873-4eda-9f2e-7954f5609030 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:19.573410 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d0a334a1-b873-4eda-9f2e-7954f5609030 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:19.594434 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d0a334a1-b873-4eda-9f2e-7954f5609030 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:19.596675 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d0a334a1-b873-4eda-9f2e-7954f5609030 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:19.597730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d0a334a1-b873-4eda-9f2e-7954f5609030 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:19.598562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d0a334a1-b873-4eda-9f2e-7954f5609030 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:19.691410 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ebfcd850-1571-469d-bebc-de33df001af3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:19.701654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ebfcd850-1571-469d-bebc-de33df001af3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:19.716860 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ebfcd850-1571-469d-bebc-de33df001af3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:19.717316 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ebfcd850-1571-469d-bebc-de33df001af3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:19.718145 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ebfcd850-1571-469d-bebc-de33df001af3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:19.718575 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ebfcd850-1571-469d-bebc-de33df001af3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:19.777227 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ebfcd850-1571-469d-bebc-de33df001af3 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093118 Aug 03 10:50:19.786273 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 427/834] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:50:19 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 10:50:19.793453 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d0a334a1-b873-4eda-9f2e-7954f5609030 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:19.806326 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d0a334a1-b873-4eda-9f2e-7954f5609030 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:19.808116 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d0a334a1-b873-4eda-9f2e-7954f5609030 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:19.809554 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d0a334a1-b873-4eda-9f2e-7954f5609030 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1738 microversion: 2.20 time: 0.241920 Aug 03 10:50:19.810595 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 408/835] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:19 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:19.876917 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-25d20a1e-ec9e-41f2-8231-585d1d407f0e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:19.877727 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-25d20a1e-ec9e-41f2-8231-585d1d407f0e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:19.885669 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-25d20a1e-ec9e-41f2-8231-585d1d407f0e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:19.886131 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-25d20a1e-ec9e-41f2-8231-585d1d407f0e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:19.886929 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-25d20a1e-ec9e-41f2-8231-585d1d407f0e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:19.887362 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-25d20a1e-ec9e-41f2-8231-585d1d407f0e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:19.916683 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-25d20a1e-ec9e-41f2-8231-585d1d407f0e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:50:20.051627 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-25d20a1e-ec9e-41f2-8231-585d1d407f0e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "DELETE /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 204 len: 0 microversion: 2.1 time: 0.181211 Aug 03 10:50:20.052537 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 428/836] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:50:19 2022] DELETE /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:50:20.062462 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2a5794f8-5721-4963-95c1-68ba08030c9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:20.063458 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2a5794f8-5721-4963-95c1-68ba08030c9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:20.069974 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2a5794f8-5721-4963-95c1-68ba08030c9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:20.070882 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2a5794f8-5721-4963-95c1-68ba08030c9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:20.071828 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2a5794f8-5721-4963-95c1-68ba08030c9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:20.072263 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2a5794f8-5721-4963-95c1-68ba08030c9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:20.277017 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2a5794f8-5721-4963-95c1-68ba08030c9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:20.284760 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2a5794f8-5721-4963-95c1-68ba08030c9a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1682 microversion: 2.1 time: 0.227347 Aug 03 10:50:20.285330 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 409/837] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:20 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:50:20.835092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9704f8f7-fd46-4d3a-9b4a-c07fc86233ff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:20.835863 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9704f8f7-fd46-4d3a-9b4a-c07fc86233ff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:20.842815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9704f8f7-fd46-4d3a-9b4a-c07fc86233ff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:20.843303 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9704f8f7-fd46-4d3a-9b4a-c07fc86233ff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:20.844095 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9704f8f7-fd46-4d3a-9b4a-c07fc86233ff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:20.844536 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9704f8f7-fd46-4d3a-9b4a-c07fc86233ff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:20.911952 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-23097897-23d9-4680-8cb0-90dbdfbfe5d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:20.912973 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-23097897-23d9-4680-8cb0-90dbdfbfe5d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:20.919743 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-23097897-23d9-4680-8cb0-90dbdfbfe5d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:20.920190 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-23097897-23d9-4680-8cb0-90dbdfbfe5d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:20.920952 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-23097897-23d9-4680-8cb0-90dbdfbfe5d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:20.921381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-23097897-23d9-4680-8cb0-90dbdfbfe5d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:20.939193 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-23097897-23d9-4680-8cb0-90dbdfbfe5d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] HTTP exception thrown: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-23097897-23d9-4680-8cb0-90dbdfbfe5d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Request method failure captured: Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: DELETE /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 HTTP/1.1 Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lFlk9wh8eaqzNROBPOv3fSdMdFyyqtYZ9fS_bPaYaFaJS1qwgKr00hbr9V0W6FuZEXPDWS6At_QzjJZv1hebwhWzb5poWKR4eQDjjv4q0PPI_fGfW_uk-hd10oRDFAfMJvN19agEHC3T9mWCmrkaxFRSVXnBpJELjSWZBGNirfyI5U Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: bcfc3e09588c48299fdf5634cda57416 Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:50:20.941103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:50:20.942695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bcfc3e09588c48299fdf5634cda57416", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:20.942695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:50:20.942695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: bcfc3e09588c48299fdf5634cda57416 Aug 03 10:50:20.942695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:50:20.942695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-AttachVolumeTestJSON-522549250-project Aug 03 10:50:20.942695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:50:20.942695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:50:20.942695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: ebdb81686d804eb3864b97481643fc2b Aug 03 10:50:20.942695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-AttachVolumeTestJSON-522549250-project Aug 03 10:50:20.942695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:50:20.942695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. Aug 03 10:50:20.942695 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '310651c9-a8fa-4169-950a-581cfdedf786'} Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:20.943500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. Aug 03 10:50:20.944701 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:20.947264 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-23097897-23d9-4680-8cb0-90dbdfbfe5d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Returning 404 to user: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:20.947264 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-23097897-23d9-4680-8cb0-90dbdfbfe5d6 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "DELETE /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 404 len: 111 microversion: 2.1 time: 0.036536 Aug 03 10:50:20.947264 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 410/838] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:50:20 2022] DELETE /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:20.953242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-668e5c60-30b2-4d35-ad8e-f4c5bc66a092 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:20.953895 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-668e5c60-30b2-4d35-ad8e-f4c5bc66a092 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: 310651c9-a8fa-4169-950a-581cfdedf786] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:20.964513 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-668e5c60-30b2-4d35-ad8e-f4c5bc66a092 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:20.965224 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-668e5c60-30b2-4d35-ad8e-f4c5bc66a092 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:20.966549 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-668e5c60-30b2-4d35-ad8e-f4c5bc66a092 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:20.967015 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-668e5c60-30b2-4d35-ad8e-f4c5bc66a092 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:20.986016 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-668e5c60-30b2-4d35-ad8e-f4c5bc66a092 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] HTTP exception thrown: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-668e5c60-30b2-4d35-ad8e-f4c5bc66a092 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Request method failure captured: Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 HTTP/1.1 Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lFlk9wh8eaqzNROBPOv3fSdMdFyyqtYZ9fS_bPaYaFaJS1qwgKr00hbr9V0W6FuZEXPDWS6At_QzjJZv1hebwhWzb5poWKR4eQDjjv4q0PPI_fGfW_uk-hd10oRDFAfMJvN19agEHC3T9mWCmrkaxFRSVXnBpJELjSWZBGNirfyI5U Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: bcfc3e09588c48299fdf5634cda57416 Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:50:20.988669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:50:20.990879 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bcfc3e09588c48299fdf5634cda57416", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:20.990879 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:50:20.990879 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: bcfc3e09588c48299fdf5634cda57416 Aug 03 10:50:20.990879 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:50:20.990879 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-AttachVolumeTestJSON-522549250-project Aug 03 10:50:20.990879 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:50:20.990879 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:50:20.990879 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: ebdb81686d804eb3864b97481643fc2b Aug 03 10:50:20.990879 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-AttachVolumeTestJSON-522549250-project Aug 03 10:50:20.990879 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:50:20.990879 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. Aug 03 10:50:20.990879 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '310651c9-a8fa-4169-950a-581cfdedf786'} Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:20.991751 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. Aug 03 10:50:20.993311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:20.994703 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-668e5c60-30b2-4d35-ad8e-f4c5bc66a092 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Returning 404 to user: Instance 310651c9-a8fa-4169-950a-581cfdedf786 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:20.994703 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-668e5c60-30b2-4d35-ad8e-f4c5bc66a092 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786" status: 404 len: 111 microversion: 2.1 time: 0.041406 Aug 03 10:50:20.994703 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 411/839] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:20 2022] GET /compute/v2.1/servers/310651c9-a8fa-4169-950a-581cfdedf786 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:21.039956 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9704f8f7-fd46-4d3a-9b4a-c07fc86233ff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:21.050767 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9704f8f7-fd46-4d3a-9b4a-c07fc86233ff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:21.052512 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9704f8f7-fd46-4d3a-9b4a-c07fc86233ff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:21.053881 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9704f8f7-fd46-4d3a-9b4a-c07fc86233ff tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1720 microversion: 2.20 time: 0.223426 Aug 03 10:50:21.057895 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 429/840] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:20 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1720 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:21.308414 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5b9b17c5-b379-43c2-ae2e-441badb2224d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:21.309393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-5b9b17c5-b379-43c2-ae2e-441badb2224d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:21.312034 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:50:21.318594 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5b9b17c5-b379-43c2-ae2e-441badb2224d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:21.319039 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5b9b17c5-b379-43c2-ae2e-441badb2224d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:21.319808 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5b9b17c5-b379-43c2-ae2e-441badb2224d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:21.320236 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5b9b17c5-b379-43c2-ae2e-441badb2224d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:21.496274 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5b9b17c5-b379-43c2-ae2e-441badb2224d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:21.505827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5b9b17c5-b379-43c2-ae2e-441badb2224d tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1682 microversion: 2.1 time: 0.202311 Aug 03 10:50:21.506481 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 412/841] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:21 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1682 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:50:22.079555 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7e0711ac-a7b3-4332-9daf-2db15355e9cc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:22.080204 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7e0711ac-a7b3-4332-9daf-2db15355e9cc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:22.087175 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7e0711ac-a7b3-4332-9daf-2db15355e9cc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:22.087634 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7e0711ac-a7b3-4332-9daf-2db15355e9cc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:22.088428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7e0711ac-a7b3-4332-9daf-2db15355e9cc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:22.089249 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7e0711ac-a7b3-4332-9daf-2db15355e9cc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:22.158503 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-00a29c7a-aa6a-443c-868f-ba585a207800 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:22.159552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-00a29c7a-aa6a-443c-868f-ba585a207800 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:22.166370 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-00a29c7a-aa6a-443c-868f-ba585a207800 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:22.166824 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-00a29c7a-aa6a-443c-868f-ba585a207800 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:22.167600 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-00a29c7a-aa6a-443c-868f-ba585a207800 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:22.168022 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-00a29c7a-aa6a-443c-868f-ba585a207800 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:22.182760 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-00a29c7a-aa6a-443c-868f-ba585a207800 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] HTTP exception thrown: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-00a29c7a-aa6a-443c-868f-ba585a207800 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Request method failure captured: Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: DELETE /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 HTTP/1.1 Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lFlk9wh8eaqzNROBPOv3fSdMdFyyqtYZ9fS_bPaYaFaJS1qwgKr00hbr9V0W6FuZEXPDWS6At_QzjJZv1hebwhWzb5poWKR4eQDjjv4q0PPI_fGfW_uk-hd10oRDFAfMJvN19agEHC3T9mWCmrkaxFRSVXnBpJELjSWZBGNirfyI5U Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: bcfc3e09588c48299fdf5634cda57416 Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:50:22.185585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:50:22.187074 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bcfc3e09588c48299fdf5634cda57416", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:22.187074 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:50:22.187074 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: bcfc3e09588c48299fdf5634cda57416 Aug 03 10:50:22.187074 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:50:22.187074 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-AttachVolumeTestJSON-522549250-project Aug 03 10:50:22.187074 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:50:22.187074 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:50:22.187074 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: ebdb81686d804eb3864b97481643fc2b Aug 03 10:50:22.187074 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-AttachVolumeTestJSON-522549250-project Aug 03 10:50:22.187074 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:50:22.187074 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. Aug 03 10:50:22.187074 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': 'fbb281c5-ccf1-4de2-99fb-5201efd51b09'} Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:22.187969 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. Aug 03 10:50:22.189257 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:22.190788 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-00a29c7a-aa6a-443c-868f-ba585a207800 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Returning 404 to user: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:22.190788 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-00a29c7a-aa6a-443c-868f-ba585a207800 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 404 len: 111 microversion: 2.1 time: 0.034699 Aug 03 10:50:22.190788 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 413/842] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:50:22 2022] DELETE /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:22.195887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ef73cd58-7d00-4420-82a1-178a34b60903 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:22.196684 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-ef73cd58-7d00-4420-82a1-178a34b60903 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] [instance: fbb281c5-ccf1-4de2-99fb-5201efd51b09] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:22.204553 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ef73cd58-7d00-4420-82a1-178a34b60903 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:22.205025 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ef73cd58-7d00-4420-82a1-178a34b60903 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:22.205859 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ef73cd58-7d00-4420-82a1-178a34b60903 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:22.206284 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ef73cd58-7d00-4420-82a1-178a34b60903 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:22.222956 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-ef73cd58-7d00-4420-82a1-178a34b60903 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] HTTP exception thrown: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ef73cd58-7d00-4420-82a1-178a34b60903 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Request method failure captured: Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 HTTP/1.1 Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lFlk9wh8eaqzNROBPOv3fSdMdFyyqtYZ9fS_bPaYaFaJS1qwgKr00hbr9V0W6FuZEXPDWS6At_QzjJZv1hebwhWzb5poWKR4eQDjjv4q0PPI_fGfW_uk-hd10oRDFAfMJvN19agEHC3T9mWCmrkaxFRSVXnBpJELjSWZBGNirfyI5U Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: bcfc3e09588c48299fdf5634cda57416 Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:50:22.224604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:50:22.227733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bcfc3e09588c48299fdf5634cda57416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bcfc3e09588c48299fdf5634cda57416", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:22.227733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:50:22.227733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: bcfc3e09588c48299fdf5634cda57416 Aug 03 10:50:22.227733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-AttachVolumeTestJSON-522549250 Aug 03 10:50:22.227733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-AttachVolumeTestJSON-522549250-project Aug 03 10:50:22.227733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:50:22.227733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:50:22.227733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: ebdb81686d804eb3864b97481643fc2b Aug 03 10:50:22.227733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-AttachVolumeTestJSON-522549250-project Aug 03 10:50:22.227733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:50:22.227733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. Aug 03 10:50:22.227733 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': 'fbb281c5-ccf1-4de2-99fb-5201efd51b09'} Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:22.230959 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. Aug 03 10:50:22.236485 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:22.238183 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ef73cd58-7d00-4420-82a1-178a34b60903 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] Returning 404 to user: Instance fbb281c5-ccf1-4de2-99fb-5201efd51b09 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:22.238183 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ef73cd58-7d00-4420-82a1-178a34b60903 tempest-AttachVolumeTestJSON-522549250 tempest-AttachVolumeTestJSON-522549250-project] 10.222.0.47 "GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09" status: 404 len: 111 microversion: 2.1 time: 0.034261 Aug 03 10:50:22.238183 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 414/843] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:22 2022] GET /compute/v2.1/servers/fbb281c5-ccf1-4de2-99fb-5201efd51b09 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 10:50:22.263606 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7e0711ac-a7b3-4332-9daf-2db15355e9cc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:22.279312 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7e0711ac-a7b3-4332-9daf-2db15355e9cc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:22.283460 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7e0711ac-a7b3-4332-9daf-2db15355e9cc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:22.285788 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7e0711ac-a7b3-4332-9daf-2db15355e9cc tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1720 microversion: 2.20 time: 0.209759 Aug 03 10:50:22.287378 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 430/844] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:22 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:22.528966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4649ef7c-f1cd-4bd1-8679-6329d2d0d022 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:22.529812 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4649ef7c-f1cd-4bd1-8679-6329d2d0d022 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:22.536634 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4649ef7c-f1cd-4bd1-8679-6329d2d0d022 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:22.537193 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4649ef7c-f1cd-4bd1-8679-6329d2d0d022 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:22.538487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4649ef7c-f1cd-4bd1-8679-6329d2d0d022 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:22.539000 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4649ef7c-f1cd-4bd1-8679-6329d2d0d022 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:22.722610 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4649ef7c-f1cd-4bd1-8679-6329d2d0d022 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:22.731323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-4649ef7c-f1cd-4bd1-8679-6329d2d0d022 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1682 microversion: 2.1 time: 0.206741 Aug 03 10:50:22.732303 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 415/845] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:22 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:50:23.326850 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f1cdf202-ada7-4a1b-b124-a37860849776 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:23.328422 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f1cdf202-ada7-4a1b-b124-a37860849776 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:23.338077 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f1cdf202-ada7-4a1b-b124-a37860849776 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:23.338911 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f1cdf202-ada7-4a1b-b124-a37860849776 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:23.339915 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f1cdf202-ada7-4a1b-b124-a37860849776 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:23.340432 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f1cdf202-ada7-4a1b-b124-a37860849776 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:23.345694 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:50:23.503130 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f1cdf202-ada7-4a1b-b124-a37860849776 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:23.512771 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f1cdf202-ada7-4a1b-b124-a37860849776 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:23.514366 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f1cdf202-ada7-4a1b-b124-a37860849776 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:23.515649 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f1cdf202-ada7-4a1b-b124-a37860849776 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1723 microversion: 2.20 time: 0.192913 Aug 03 10:50:23.516090 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 431/846] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:23 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:23.539339 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-baa6d190-9c92-4b95-937a-7eb3059fe77f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2655596-5cf6-4cf0-b49e-0ba4e9195c30"}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:50:23.542006 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-baa6d190-9c92-4b95-937a-7eb3059fe77f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:23.565675 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-baa6d190-9c92-4b95-937a-7eb3059fe77f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:23.566135 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-baa6d190-9c92-4b95-937a-7eb3059fe77f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:23.567377 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-baa6d190-9c92-4b95-937a-7eb3059fe77f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:23.567377 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-baa6d190-9c92-4b95-937a-7eb3059fe77f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:23.698244 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-fe7a1203-2e23-4d53-a9df-703055acab51 req-de45e9ea-e701-48a8-85b9-d74425f228a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53cc123d-d9f0-4035-ad45-42ba2f585c90", "name": "network-vif-unplugged", "status": "completed", "tag": "124f697b-af93-48b0-a073-3647bab4089e"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:50:23.713494 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-fe7a1203-2e23-4d53-a9df-703055acab51 req-de45e9ea-e701-48a8-85b9-d74425f228a8 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:23.718157 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-fe7a1203-2e23-4d53-a9df-703055acab51 req-de45e9ea-e701-48a8-85b9-d74425f228a8 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:23.740555 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-fe7a1203-2e23-4d53-a9df-703055acab51 req-de45e9ea-e701-48a8-85b9-d74425f228a8 service nova] Creating event network-vif-unplugged:124f697b-af93-48b0-a073-3647bab4089e for instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 on hv-cinder-85083 Aug 03 10:50:23.748818 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-fe7a1203-2e23-4d53-a9df-703055acab51 req-de45e9ea-e701-48a8-85b9-d74425f228a8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056369 Aug 03 10:50:23.751071 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 432/847] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:50:23.763292 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0cbfe4e6-8bd3-4515-8bd6-0645d1eb086f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:23.765979 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0cbfe4e6-8bd3-4515-8bd6-0645d1eb086f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:23.775514 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0cbfe4e6-8bd3-4515-8bd6-0645d1eb086f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:23.776028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0cbfe4e6-8bd3-4515-8bd6-0645d1eb086f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:23.777262 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0cbfe4e6-8bd3-4515-8bd6-0645d1eb086f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:23.777751 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0cbfe4e6-8bd3-4515-8bd6-0645d1eb086f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:24.024654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0cbfe4e6-8bd3-4515-8bd6-0645d1eb086f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:24.036953 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0cbfe4e6-8bd3-4515-8bd6-0645d1eb086f tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1682 microversion: 2.1 time: 0.283460 Aug 03 10:50:24.049513 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 433/848] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:23 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1682 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:50:24.075725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:50:24.089979 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-baa6d190-9c92-4b95-937a-7eb3059fe77f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "POST /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.551735 Aug 03 10:50:24.091950 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 416/849] 10.222.0.47 () {62 vars in 1364 bytes} [Wed Aug 3 10:50:23 2022] POST /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263/os-volume_attachments => generated 188 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 10:50:24.239652 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0d413d84-cbae-447d-a4d8-662f15893488 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:24.240267 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0d413d84-cbae-447d-a4d8-662f15893488 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:24.247657 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d413d84-cbae-447d-a4d8-662f15893488 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:24.248419 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d413d84-cbae-447d-a4d8-662f15893488 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:24.249553 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d413d84-cbae-447d-a4d8-662f15893488 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:24.250119 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d413d84-cbae-447d-a4d8-662f15893488 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:24.605812 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0d413d84-cbae-447d-a4d8-662f15893488 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "DELETE /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263/os-volume_attachments/f2655596-5cf6-4cf0-b49e-0ba4e9195c30" status: 202 len: 0 microversion: 2.20 time: 0.370327 Aug 03 10:50:24.609701 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 434/850] 10.222.0.47 () {60 vars in 1457 bytes} [Wed Aug 3 10:50:24 2022] DELETE /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263/os-volume_attachments/f2655596-5cf6-4cf0-b49e-0ba4e9195c30 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 03 10:50:24.674657 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6e627a08-4ba1-4978-ac31-9f3ec8a41e09 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:50:24.675249 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6e627a08-4ba1-4978-ac31-9f3ec8a41e09 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:24.687867 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e627a08-4ba1-4978-ac31-9f3ec8a41e09 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:24.688391 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e627a08-4ba1-4978-ac31-9f3ec8a41e09 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:24.689270 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e627a08-4ba1-4978-ac31-9f3ec8a41e09 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:24.689975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e627a08-4ba1-4978-ac31-9f3ec8a41e09 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:24.878292 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-1e828a56-4651-4825-aad1-e4424a6ff602 req-c43a2b82-eff6-48aa-ba22-f939eed24c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53cc123d-d9f0-4035-ad45-42ba2f585c90", "name": "network-vif-deleted", "tag": "124f697b-af93-48b0-a073-3647bab4089e"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:50:24.906435 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-1e828a56-4651-4825-aad1-e4424a6ff602 req-c43a2b82-eff6-48aa-ba22-f939eed24c89 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:24.908481 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-1e828a56-4651-4825-aad1-e4424a6ff602 req-c43a2b82-eff6-48aa-ba22-f939eed24c89 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:24.928585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6e627a08-4ba1-4978-ac31-9f3ec8a41e09 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124389) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 10:50:24.928821 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-1e828a56-4651-4825-aad1-e4424a6ff602 req-c43a2b82-eff6-48aa-ba22-f939eed24c89 service nova] Creating event network-vif-deleted:124f697b-af93-48b0-a073-3647bab4089e for instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 on hv-cinder-85083 Aug 03 10:50:24.940089 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-1e828a56-4651-4825-aad1-e4424a6ff602 req-c43a2b82-eff6-48aa-ba22-f939eed24c89 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066258 Aug 03 10:50:24.941906 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 435/851] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:25.030771 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-6e627a08-4ba1-4978-ac31-9f3ec8a41e09 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "POST /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263/action" status: 202 len: 0 microversion: 2.20 time: 0.360067 Aug 03 10:50:25.034790 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 417/852] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Aug 3 10:50:24 2022] POST /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:50:25.041101 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-aaf86aab-2605-403a-b24c-7a539a99d121 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:25.042093 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-aaf86aab-2605-403a-b24c-7a539a99d121 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:25.051017 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aaf86aab-2605-403a-b24c-7a539a99d121 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:25.051715 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aaf86aab-2605-403a-b24c-7a539a99d121 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:25.052661 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aaf86aab-2605-403a-b24c-7a539a99d121 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:25.053256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aaf86aab-2605-403a-b24c-7a539a99d121 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:25.064045 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3be0a1f1-03de-44a3-b2f2-abc7d0dcf01e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:25.064710 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3be0a1f1-03de-44a3-b2f2-abc7d0dcf01e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:25.082628 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3be0a1f1-03de-44a3-b2f2-abc7d0dcf01e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:25.083092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3be0a1f1-03de-44a3-b2f2-abc7d0dcf01e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:25.085404 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3be0a1f1-03de-44a3-b2f2-abc7d0dcf01e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:25.088146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3be0a1f1-03de-44a3-b2f2-abc7d0dcf01e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:25.170395 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3be0a1f1-03de-44a3-b2f2-abc7d0dcf01e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:25.170996 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3be0a1f1-03de-44a3-b2f2-abc7d0dcf01e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:25.171597 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-3be0a1f1-03de-44a3-b2f2-abc7d0dcf01e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lazy-loading 'fault' on Instance uuid 53cc123d-d9f0-4035-ad45-42ba2f585c90 {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:50:25.324632 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3be0a1f1-03de-44a3-b2f2-abc7d0dcf01e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956aff831fa04d29ba5cffb88e73f4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40540f8322a54133bc32e1af000810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:25.337044 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3be0a1f1-03de-44a3-b2f2-abc7d0dcf01e tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 200 len: 1331 microversion: 2.1 time: 0.275176 Aug 03 10:50:25.365588 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 418/853] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:25 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 1331 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:50:25.426128 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-aaf86aab-2605-403a-b24c-7a539a99d121 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:25.442427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-aaf86aab-2605-403a-b24c-7a539a99d121 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:25.444778 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-aaf86aab-2605-403a-b24c-7a539a99d121 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:25.446559 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-aaf86aab-2605-403a-b24c-7a539a99d121 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1671 microversion: 2.20 time: 0.409559 Aug 03 10:50:25.461842 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 436/854] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:25 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1671 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:25.794661 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-a270eb89-ca38-4b87-90df-98ab16f9e811 req-8ea78a87-f206-4157-bede-07a079f67f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cbe8d4-0681-4b94-a774-1f0067f69263", "name": "network-vif-unplugged", "status": "completed", "tag": "5c7bb60f-6fc3-4d3d-bda1-d77d9a5e91fb"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:50:25.832405 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-a270eb89-ca38-4b87-90df-98ab16f9e811 req-8ea78a87-f206-4157-bede-07a079f67f1d service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:25.834146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-a270eb89-ca38-4b87-90df-98ab16f9e811 req-8ea78a87-f206-4157-bede-07a079f67f1d service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:25.861737 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.compute.server_external_events [req-a270eb89-ca38-4b87-90df-98ab16f9e811 req-8ea78a87-f206-4157-bede-07a079f67f1d service nova] Unable to find a host for instance 99cbe8d4-0681-4b94-a774-1f0067f69263. Dropping event network-vif-unplugged {{(pid=124389) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 10:50:25.862989 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-a270eb89-ca38-4b87-90df-98ab16f9e811 req-8ea78a87-f206-4157-bede-07a079f67f1d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.072826 Aug 03 10:50:25.864617 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 419/855] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 03 10:50:26.361159 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-11c00f38-27eb-4e4a-b964-8cbd456011f5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:26.363243 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-11c00f38-27eb-4e4a-b964-8cbd456011f5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:26.372839 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11c00f38-27eb-4e4a-b964-8cbd456011f5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:26.373735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11c00f38-27eb-4e4a-b964-8cbd456011f5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:26.374766 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11c00f38-27eb-4e4a-b964-8cbd456011f5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:26.375462 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11c00f38-27eb-4e4a-b964-8cbd456011f5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:26.393661 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-11c00f38-27eb-4e4a-b964-8cbd456011f5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] HTTP exception thrown: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-11c00f38-27eb-4e4a-b964-8cbd456011f5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Request method failure captured: Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 HTTP/1.1 Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFpofOqKz5CBf-8MdepxWHeAf9pqHZ8ygUVMa40UQbmj6S4Pciia3iBGqdVVK2sWWb-uohBfvQN9NFiLpHXqxqcuFtxzwWGZSpwMcdozNESD7s6BjUOpefCniYDb7sEM8Bcsphf4xva9kPBkQalQSLDW-EAJxbqQOqGbR6FCdDQnOg Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:50:26.395711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:50:26.397204 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/40540f8322a54133bc32e1af000810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_40540f8322a54133bc32e1af000810ad", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:26.397204 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:26.397204 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:26.397204 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:26.397204 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:26.397204 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:50:26.397204 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:50:26.397204 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 956aff831fa04d29ba5cffb88e73f4d2 Aug 03 10:50:26.397204 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:26.397204 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:50:26.397204 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. Aug 03 10:50:26.397204 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': '53cc123d-d9f0-4035-ad45-42ba2f585c90'} Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:26.398028 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. Aug 03 10:50:26.399707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:26.401097 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-11c00f38-27eb-4e4a-b964-8cbd456011f5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Returning 404 to user: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:26.401097 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-11c00f38-27eb-4e4a-b964-8cbd456011f5 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 404 len: 111 microversion: 2.1 time: 0.040225 Aug 03 10:50:26.401673 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 437/856] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:26 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:26.406495 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-7dc17990-4873-46ca-baa4-6e4add9bf623 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '.version_select at 0x7fbd105008b0>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:26.428728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-7dc17990-4873-46ca-baa4-6e4add9bf623 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1999273207" status: 202 len: 0 microversion: 2.1 time: 0.026146 Aug 03 10:50:26.429927 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 420/857] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Aug 3 10:50:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1999273207 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:50:26.485538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3a71883e-67d1-4373-8772-ff9fd3bc081a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:26.486576 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3a71883e-67d1-4373-8772-ff9fd3bc081a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:26.495072 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3a71883e-67d1-4373-8772-ff9fd3bc081a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:26.495780 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3a71883e-67d1-4373-8772-ff9fd3bc081a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:26.496744 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3a71883e-67d1-4373-8772-ff9fd3bc081a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:26.497559 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3a71883e-67d1-4373-8772-ff9fd3bc081a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:27.042340 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3a71883e-67d1-4373-8772-ff9fd3bc081a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:27.056872 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3a71883e-67d1-4373-8772-ff9fd3bc081a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:27.058713 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3a71883e-67d1-4373-8772-ff9fd3bc081a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:27.060214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3a71883e-67d1-4373-8772-ff9fd3bc081a tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.578752 Aug 03 10:50:27.061312 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 438/858] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:26 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:50:28.090240 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5a4ea33e-ed17-418b-b3cc-8305010b222d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:28.091092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-5a4ea33e-ed17-418b-b3cc-8305010b222d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:28.097427 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5a4ea33e-ed17-418b-b3cc-8305010b222d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:28.098172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5a4ea33e-ed17-418b-b3cc-8305010b222d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:28.099042 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5a4ea33e-ed17-418b-b3cc-8305010b222d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:28.100089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5a4ea33e-ed17-418b-b3cc-8305010b222d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:28.272594 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5a4ea33e-ed17-418b-b3cc-8305010b222d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:28.288513 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5a4ea33e-ed17-418b-b3cc-8305010b222d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:28.291068 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5a4ea33e-ed17-418b-b3cc-8305010b222d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:28.292448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5a4ea33e-ed17-418b-b3cc-8305010b222d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.212350 Aug 03 10:50:28.293585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 421/859] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:28 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:29.009304 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a58aeb50-3410-46c6-be1b-b30bf8738f23 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:29.009835 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a58aeb50-3410-46c6-be1b-b30bf8738f23 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:29.023053 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a58aeb50-3410-46c6-be1b-b30bf8738f23 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:29.023501 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a58aeb50-3410-46c6-be1b-b30bf8738f23 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:29.024312 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a58aeb50-3410-46c6-be1b-b30bf8738f23 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:29.024776 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a58aeb50-3410-46c6-be1b-b30bf8738f23 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:29.057086 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-a58aeb50-3410-46c6-be1b-b30bf8738f23 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] HTTP exception thrown: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a58aeb50-3410-46c6-be1b-b30bf8738f23 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Request method failure captured: Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: DELETE /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 HTTP/1.1 Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFpofOqKz5CBf-8MdepxWHeAf9pqHZ8ygUVMa40UQbmj6S4Pciia3iBGqdVVK2sWWb-uohBfvQN9NFiLpHXqxqcuFtxzwWGZSpwMcdozNESD7s6BjUOpefCniYDb7sEM8Bcsphf4xva9kPBkQalQSLDW-EAJxbqQOqGbR6FCdDQnOg Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:50:29.058721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:50:29.060164 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/40540f8322a54133bc32e1af000810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_40540f8322a54133bc32e1af000810ad", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:29.060164 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:29.060164 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:29.060164 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:29.060164 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:29.060164 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:50:29.060164 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:50:29.060164 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 956aff831fa04d29ba5cffb88e73f4d2 Aug 03 10:50:29.060164 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:29.060164 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:50:29.060164 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. Aug 03 10:50:29.060164 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': '53cc123d-d9f0-4035-ad45-42ba2f585c90'} Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:29.064129 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. Aug 03 10:50:29.065408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:29.068601 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a58aeb50-3410-46c6-be1b-b30bf8738f23 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Returning 404 to user: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:29.068601 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a58aeb50-3410-46c6-be1b-b30bf8738f23 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "DELETE /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 404 len: 111 microversion: 2.1 time: 0.056717 Aug 03 10:50:29.068601 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 439/860] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:50:29 2022] DELETE /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:29.068998 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-427ed947-b9af-4419-86bb-f183198e4856 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:29.069645 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-427ed947-b9af-4419-86bb-f183198e4856 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 53cc123d-d9f0-4035-ad45-42ba2f585c90] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:29.081236 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-427ed947-b9af-4419-86bb-f183198e4856 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:29.082130 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-427ed947-b9af-4419-86bb-f183198e4856 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:29.082912 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-427ed947-b9af-4419-86bb-f183198e4856 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:29.083356 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-427ed947-b9af-4419-86bb-f183198e4856 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:29.111320 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-427ed947-b9af-4419-86bb-f183198e4856 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] HTTP exception thrown: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-427ed947-b9af-4419-86bb-f183198e4856 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Request method failure captured: Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 HTTP/1.1 Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lFpofOqKz5CBf-8MdepxWHeAf9pqHZ8ygUVMa40UQbmj6S4Pciia3iBGqdVVK2sWWb-uohBfvQN9NFiLpHXqxqcuFtxzwWGZSpwMcdozNESD7s6BjUOpefCniYDb7sEM8Bcsphf4xva9kPBkQalQSLDW-EAJxbqQOqGbR6FCdDQnOg Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:50:29.112893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:50:29.114767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/40540f8322a54133bc32e1af000810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_40540f8322a54133bc32e1af000810ad", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:29.114767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:29.114767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:29.114767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:29.114767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:29.114767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:50:29.114767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:50:29.114767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 956aff831fa04d29ba5cffb88e73f4d2 Aug 03 10:50:29.114767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:29.114767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:50:29.114767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. Aug 03 10:50:29.114767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '53cc123d-d9f0-4035-ad45-42ba2f585c90'} Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:29.115730 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. Aug 03 10:50:29.117160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:29.124562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-427ed947-b9af-4419-86bb-f183198e4856 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Returning 404 to user: Instance 53cc123d-d9f0-4035-ad45-42ba2f585c90 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:29.127076 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-427ed947-b9af-4419-86bb-f183198e4856 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90" status: 404 len: 111 microversion: 2.1 time: 0.062150 Aug 03 10:50:29.130241 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 422/861] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:29 2022] GET /compute/v2.1/servers/53cc123d-d9f0-4035-ad45-42ba2f585c90 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:29.320573 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-19c4118f-5441-4fb8-b9b5-ab77010d0147 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:29.321947 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-19c4118f-5441-4fb8-b9b5-ab77010d0147 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:29.340006 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19c4118f-5441-4fb8-b9b5-ab77010d0147 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:29.341298 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19c4118f-5441-4fb8-b9b5-ab77010d0147 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:29.342983 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19c4118f-5441-4fb8-b9b5-ab77010d0147 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:29.347918 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19c4118f-5441-4fb8-b9b5-ab77010d0147 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:29.683140 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-19c4118f-5441-4fb8-b9b5-ab77010d0147 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:29.696561 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-19c4118f-5441-4fb8-b9b5-ab77010d0147 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:29.723804 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-19c4118f-5441-4fb8-b9b5-ab77010d0147 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:29.730899 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-19c4118f-5441-4fb8-b9b5-ab77010d0147 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.418439 Aug 03 10:50:29.731492 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 440/862] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:29 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:30.381244 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-06aa1e27-364c-4a7d-a3e1-3ce5ebeb9e54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:30.382130 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-06aa1e27-364c-4a7d-a3e1-3ce5ebeb9e54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:30.398453 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-06aa1e27-364c-4a7d-a3e1-3ce5ebeb9e54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:30.399780 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-06aa1e27-364c-4a7d-a3e1-3ce5ebeb9e54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:30.400935 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-06aa1e27-364c-4a7d-a3e1-3ce5ebeb9e54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:30.401661 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-06aa1e27-364c-4a7d-a3e1-3ce5ebeb9e54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:30.426088 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-06aa1e27-364c-4a7d-a3e1-3ce5ebeb9e54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] HTTP exception thrown: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-06aa1e27-364c-4a7d-a3e1-3ce5ebeb9e54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Request method failure captured: Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: DELETE /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 HTTP/1.1 Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lFpofOqKz5CBf-8MdepxWHeAf9pqHZ8ygUVMa40UQbmj6S4Pciia3iBGqdVVK2sWWb-uohBfvQN9NFiLpHXqxqcuFtxzwWGZSpwMcdozNESD7s6BjUOpefCniYDb7sEM8Bcsphf4xva9kPBkQalQSLDW-EAJxbqQOqGbR6FCdDQnOg Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:50:30.428547 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:50:30.430233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/40540f8322a54133bc32e1af000810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_40540f8322a54133bc32e1af000810ad", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:30.430233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:30.430233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:30.430233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:30.430233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:30.430233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:50:30.430233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:50:30.430233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 956aff831fa04d29ba5cffb88e73f4d2 Aug 03 10:50:30.430233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:30.430233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:50:30.430233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. Aug 03 10:50:30.430233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '848ceec4-9b34-4e0f-a57e-95de02097455'} Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:30.431081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. Aug 03 10:50:30.432457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.434946 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-06aa1e27-364c-4a7d-a3e1-3ce5ebeb9e54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Returning 404 to user: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:30.436109 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-06aa1e27-364c-4a7d-a3e1-3ce5ebeb9e54 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "DELETE /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 404 len: 111 microversion: 2.1 time: 0.059982 Aug 03 10:50:30.437261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 423/863] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:50:30 2022] DELETE /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:30.448948 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8bc9fc10-0fbe-4ccf-b750-eeddf972df04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:30.451144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8bc9fc10-0fbe-4ccf-b750-eeddf972df04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: 848ceec4-9b34-4e0f-a57e-95de02097455] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:30.469613 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8bc9fc10-0fbe-4ccf-b750-eeddf972df04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:30.478524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8bc9fc10-0fbe-4ccf-b750-eeddf972df04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:30.486531 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8bc9fc10-0fbe-4ccf-b750-eeddf972df04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:30.487097 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8bc9fc10-0fbe-4ccf-b750-eeddf972df04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:30.520470 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-8bc9fc10-0fbe-4ccf-b750-eeddf972df04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] HTTP exception thrown: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8bc9fc10-0fbe-4ccf-b750-eeddf972df04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Request method failure captured: Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 HTTP/1.1 Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFpofOqKz5CBf-8MdepxWHeAf9pqHZ8ygUVMa40UQbmj6S4Pciia3iBGqdVVK2sWWb-uohBfvQN9NFiLpHXqxqcuFtxzwWGZSpwMcdozNESD7s6BjUOpefCniYDb7sEM8Bcsphf4xva9kPBkQalQSLDW-EAJxbqQOqGbR6FCdDQnOg Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:50:30.523965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:50:30.526478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/40540f8322a54133bc32e1af000810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_40540f8322a54133bc32e1af000810ad", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:30.526478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:30.526478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:30.526478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:30.526478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:30.526478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:50:30.526478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:50:30.526478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 956aff831fa04d29ba5cffb88e73f4d2 Aug 03 10:50:30.526478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:30.526478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:50:30.526478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. Aug 03 10:50:30.526478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': '848ceec4-9b34-4e0f-a57e-95de02097455'} Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:30.527524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. Aug 03 10:50:30.529211 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.531803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8bc9fc10-0fbe-4ccf-b750-eeddf972df04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Returning 404 to user: Instance 848ceec4-9b34-4e0f-a57e-95de02097455 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:30.533114 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8bc9fc10-0fbe-4ccf-b750-eeddf972df04 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455" status: 404 len: 111 microversion: 2.1 time: 0.091336 Aug 03 10:50:30.533959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 441/864] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:30 2022] GET /compute/v2.1/servers/848ceec4-9b34-4e0f-a57e-95de02097455 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:30.559518 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-aae27b11-16e0-431d-8878-5e4d1511887b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:30.560040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-aae27b11-16e0-431d-8878-5e4d1511887b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:30.567755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aae27b11-16e0-431d-8878-5e4d1511887b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:30.568456 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aae27b11-16e0-431d-8878-5e4d1511887b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:30.569369 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aae27b11-16e0-431d-8878-5e4d1511887b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:30.569993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-aae27b11-16e0-431d-8878-5e4d1511887b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:30.588047 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-aae27b11-16e0-431d-8878-5e4d1511887b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] HTTP exception thrown: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-aae27b11-16e0-431d-8878-5e4d1511887b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Request method failure captured: Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: DELETE /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 HTTP/1.1 Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lFpofOqKz5CBf-8MdepxWHeAf9pqHZ8ygUVMa40UQbmj6S4Pciia3iBGqdVVK2sWWb-uohBfvQN9NFiLpHXqxqcuFtxzwWGZSpwMcdozNESD7s6BjUOpefCniYDb7sEM8Bcsphf4xva9kPBkQalQSLDW-EAJxbqQOqGbR6FCdDQnOg Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:50:30.589814 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:50:30.591146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/40540f8322a54133bc32e1af000810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_40540f8322a54133bc32e1af000810ad", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:30.591146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:30.591146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:30.591146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:30.591146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:30.591146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:50:30.591146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:50:30.591146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 956aff831fa04d29ba5cffb88e73f4d2 Aug 03 10:50:30.591146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:30.591146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:50:30.591146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. Aug 03 10:50:30.591146 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': 'd121b133-039a-4f9c-9caa-299cc961d570'} Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:30.591872 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. Aug 03 10:50:30.593094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.596322 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-aae27b11-16e0-431d-8878-5e4d1511887b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Returning 404 to user: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:30.596322 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-aae27b11-16e0-431d-8878-5e4d1511887b tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 404 len: 111 microversion: 2.1 time: 0.050153 Aug 03 10:50:30.596322 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 424/865] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:50:30 2022] DELETE /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:30.601137 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4891ffb2-e4af-4276-88b7-0f3510b46367 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:30.601799 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4891ffb2-e4af-4276-88b7-0f3510b46367 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: d121b133-039a-4f9c-9caa-299cc961d570] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:30.608955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4891ffb2-e4af-4276-88b7-0f3510b46367 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:30.609560 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4891ffb2-e4af-4276-88b7-0f3510b46367 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:30.610422 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4891ffb2-e4af-4276-88b7-0f3510b46367 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:30.610922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4891ffb2-e4af-4276-88b7-0f3510b46367 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:30.627190 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-4891ffb2-e4af-4276-88b7-0f3510b46367 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] HTTP exception thrown: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4891ffb2-e4af-4276-88b7-0f3510b46367 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Request method failure captured: Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 HTTP/1.1 Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFpofOqKz5CBf-8MdepxWHeAf9pqHZ8ygUVMa40UQbmj6S4Pciia3iBGqdVVK2sWWb-uohBfvQN9NFiLpHXqxqcuFtxzwWGZSpwMcdozNESD7s6BjUOpefCniYDb7sEM8Bcsphf4xva9kPBkQalQSLDW-EAJxbqQOqGbR6FCdDQnOg Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:50:30.628754 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:50:30.630390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/40540f8322a54133bc32e1af000810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_40540f8322a54133bc32e1af000810ad", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:30.630390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:30.630390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:30.630390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:30.630390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:30.630390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:50:30.630390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:50:30.630390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 956aff831fa04d29ba5cffb88e73f4d2 Aug 03 10:50:30.630390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:30.630390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:50:30.630390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. Aug 03 10:50:30.630390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': 'd121b133-039a-4f9c-9caa-299cc961d570'} Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:30.632151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. Aug 03 10:50:30.634218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:30.635617 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4891ffb2-e4af-4276-88b7-0f3510b46367 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Returning 404 to user: Instance d121b133-039a-4f9c-9caa-299cc961d570 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:30.635617 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4891ffb2-e4af-4276-88b7-0f3510b46367 tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570" status: 404 len: 111 microversion: 2.1 time: 0.033209 Aug 03 10:50:30.635617 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 442/866] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:30 2022] GET /compute/v2.1/servers/d121b133-039a-4f9c-9caa-299cc961d570 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:30.761894 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-02f8e0d8-4521-4e04-96a4-d60028069cd6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:30.762496 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-02f8e0d8-4521-4e04-96a4-d60028069cd6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:30.768837 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-02f8e0d8-4521-4e04-96a4-d60028069cd6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:30.769287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-02f8e0d8-4521-4e04-96a4-d60028069cd6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:30.770305 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-02f8e0d8-4521-4e04-96a4-d60028069cd6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:30.770913 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-02f8e0d8-4521-4e04-96a4-d60028069cd6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:31.134211 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-02f8e0d8-4521-4e04-96a4-d60028069cd6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:31.150230 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-02f8e0d8-4521-4e04-96a4-d60028069cd6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:31.151912 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-02f8e0d8-4521-4e04-96a4-d60028069cd6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:31.153210 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-02f8e0d8-4521-4e04-96a4-d60028069cd6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.395771 Aug 03 10:50:31.154216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 425/867] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:30 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:31.826638 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-992cdd2a-cddb-4f4b-9c43-bb9e9faaf93a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:31.827252 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-992cdd2a-cddb-4f4b-9c43-bb9e9faaf93a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:31.834056 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-992cdd2a-cddb-4f4b-9c43-bb9e9faaf93a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:31.834587 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-992cdd2a-cddb-4f4b-9c43-bb9e9faaf93a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:31.835476 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-992cdd2a-cddb-4f4b-9c43-bb9e9faaf93a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:31.835968 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-992cdd2a-cddb-4f4b-9c43-bb9e9faaf93a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:31.852268 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-992cdd2a-cddb-4f4b-9c43-bb9e9faaf93a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] HTTP exception thrown: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-992cdd2a-cddb-4f4b-9c43-bb9e9faaf93a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Request method failure captured: Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: DELETE /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc HTTP/1.1 Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFpofOqKz5CBf-8MdepxWHeAf9pqHZ8ygUVMa40UQbmj6S4Pciia3iBGqdVVK2sWWb-uohBfvQN9NFiLpHXqxqcuFtxzwWGZSpwMcdozNESD7s6BjUOpefCniYDb7sEM8Bcsphf4xva9kPBkQalQSLDW-EAJxbqQOqGbR6FCdDQnOg Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:50:31.855431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:50:31.857092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/40540f8322a54133bc32e1af000810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_40540f8322a54133bc32e1af000810ad", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:31.857092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:31.857092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:31.857092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:31.857092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:31.857092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:50:31.857092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:50:31.857092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 956aff831fa04d29ba5cffb88e73f4d2 Aug 03 10:50:31.857092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:31.857092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:50:31.857092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. Aug 03 10:50:31.857092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': 'b6a399a7-91eb-41c8-b408-c5df154a36cc'} Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:31.858085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. Aug 03 10:50:31.859452 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:31.861696 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-992cdd2a-cddb-4f4b-9c43-bb9e9faaf93a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Returning 404 to user: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:31.862884 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-992cdd2a-cddb-4f4b-9c43-bb9e9faaf93a tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 404 len: 111 microversion: 2.1 time: 0.040224 Aug 03 10:50:31.867269 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 443/868] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:50:31 2022] DELETE /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:31.872285 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-58e1d9b4-1a33-41fd-942f-99ab845a431c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:31.877721 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-58e1d9b4-1a33-41fd-942f-99ab845a431c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] [instance: b6a399a7-91eb-41c8-b408-c5df154a36cc] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:31.894454 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-58e1d9b4-1a33-41fd-942f-99ab845a431c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:31.895472 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-58e1d9b4-1a33-41fd-942f-99ab845a431c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:31.897502 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-58e1d9b4-1a33-41fd-942f-99ab845a431c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:31.899658 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-58e1d9b4-1a33-41fd-942f-99ab845a431c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:31.926550 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-58e1d9b4-1a33-41fd-942f-99ab845a431c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] HTTP exception thrown: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-58e1d9b4-1a33-41fd-942f-99ab845a431c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Request method failure captured: Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc HTTP/1.1 Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lFpofOqKz5CBf-8MdepxWHeAf9pqHZ8ygUVMa40UQbmj6S4Pciia3iBGqdVVK2sWWb-uohBfvQN9NFiLpHXqxqcuFtxzwWGZSpwMcdozNESD7s6BjUOpefCniYDb7sEM8Bcsphf4xva9kPBkQalQSLDW-EAJxbqQOqGbR6FCdDQnOg Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:50:31.928775 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:50:31.930975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/40540f8322a54133bc32e1af000810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/40540f8322a54133bc32e1af000810ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_40540f8322a54133bc32e1af000810ad", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:31.930975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:31.930975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: 40540f8322a54133bc32e1af000810ad Aug 03 10:50:31.930975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1688335685 Aug 03 10:50:31.930975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:31.930975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:50:31.930975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:50:31.930975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 956aff831fa04d29ba5cffb88e73f4d2 Aug 03 10:50:31.930975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-AttachVolumeNegativeTest-1688335685-project Aug 03 10:50:31.930975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:50:31.930975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. Aug 03 10:50:31.930975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': 'b6a399a7-91eb-41c8-b408-c5df154a36cc'} Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:31.931849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. Aug 03 10:50:31.933552 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:31.936525 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-58e1d9b4-1a33-41fd-942f-99ab845a431c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] Returning 404 to user: Instance b6a399a7-91eb-41c8-b408-c5df154a36cc could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:31.937594 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-58e1d9b4-1a33-41fd-942f-99ab845a431c tempest-AttachVolumeNegativeTest-1688335685 tempest-AttachVolumeNegativeTest-1688335685-project] 10.222.0.47 "GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc" status: 404 len: 111 microversion: 2.1 time: 0.069159 Aug 03 10:50:31.939029 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 426/869] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:50:31 2022] GET /compute/v2.1/servers/b6a399a7-91eb-41c8-b408-c5df154a36cc => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:32.184073 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1c7a17cc-77d2-49bb-b6e8-3651f3126111 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:32.185237 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1c7a17cc-77d2-49bb-b6e8-3651f3126111 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:32.198436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1c7a17cc-77d2-49bb-b6e8-3651f3126111 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:32.199341 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1c7a17cc-77d2-49bb-b6e8-3651f3126111 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:32.200358 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1c7a17cc-77d2-49bb-b6e8-3651f3126111 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:32.201032 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1c7a17cc-77d2-49bb-b6e8-3651f3126111 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:32.511253 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1c7a17cc-77d2-49bb-b6e8-3651f3126111 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:32.532914 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1c7a17cc-77d2-49bb-b6e8-3651f3126111 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:32.536174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1c7a17cc-77d2-49bb-b6e8-3651f3126111 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:32.538337 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1c7a17cc-77d2-49bb-b6e8-3651f3126111 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.361787 Aug 03 10:50:32.539133 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 444/870] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:32 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:33.574417 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-dc14dcc5-25c1-4da1-ab91-b9f9820fe4f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:33.575859 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-dc14dcc5-25c1-4da1-ab91-b9f9820fe4f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:33.584947 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dc14dcc5-25c1-4da1-ab91-b9f9820fe4f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:33.585787 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dc14dcc5-25c1-4da1-ab91-b9f9820fe4f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:33.586778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dc14dcc5-25c1-4da1-ab91-b9f9820fe4f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:33.587269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dc14dcc5-25c1-4da1-ab91-b9f9820fe4f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:34.009202 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-dc14dcc5-25c1-4da1-ab91-b9f9820fe4f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:34.018782 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-dc14dcc5-25c1-4da1-ab91-b9f9820fe4f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:34.021911 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-dc14dcc5-25c1-4da1-ab91-b9f9820fe4f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:34.026970 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-dc14dcc5-25c1-4da1-ab91-b9f9820fe4f2 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.464799 Aug 03 10:50:34.030015 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 427/871] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:33 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:35.056181 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-96760290-b098-45d5-8204-9539f5533ad6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:35.056825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-96760290-b098-45d5-8204-9539f5533ad6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:35.079071 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-96760290-b098-45d5-8204-9539f5533ad6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:35.079472 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-96760290-b098-45d5-8204-9539f5533ad6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:35.080746 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-96760290-b098-45d5-8204-9539f5533ad6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:35.081722 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-96760290-b098-45d5-8204-9539f5533ad6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:35.629813 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-96760290-b098-45d5-8204-9539f5533ad6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:35.675187 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-96760290-b098-45d5-8204-9539f5533ad6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:35.693168 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-96760290-b098-45d5-8204-9539f5533ad6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:35.695651 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-96760290-b098-45d5-8204-9539f5533ad6 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.645176 Aug 03 10:50:35.720640 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 445/872] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:35 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:36.732727 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-8d68ca04-3747-4e33-a0ed-f96b68cd4c2c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:36.734632 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-8d68ca04-3747-4e33-a0ed-f96b68cd4c2c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:36.778779 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8d68ca04-3747-4e33-a0ed-f96b68cd4c2c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:36.784059 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8d68ca04-3747-4e33-a0ed-f96b68cd4c2c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:36.791008 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8d68ca04-3747-4e33-a0ed-f96b68cd4c2c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:36.793937 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-8d68ca04-3747-4e33-a0ed-f96b68cd4c2c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:37.341448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-8d68ca04-3747-4e33-a0ed-f96b68cd4c2c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:37.374551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-8d68ca04-3747-4e33-a0ed-f96b68cd4c2c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:37.376519 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-8d68ca04-3747-4e33-a0ed-f96b68cd4c2c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:37.378347 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-8d68ca04-3747-4e33-a0ed-f96b68cd4c2c tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.654088 Aug 03 10:50:37.386612 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 428/873] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:36 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:38.417233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ebaf047e-93d2-4e40-869e-33b3bfb7c10e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:38.418705 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ebaf047e-93d2-4e40-869e-33b3bfb7c10e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:38.427254 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ebaf047e-93d2-4e40-869e-33b3bfb7c10e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:38.428169 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ebaf047e-93d2-4e40-869e-33b3bfb7c10e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:38.430536 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ebaf047e-93d2-4e40-869e-33b3bfb7c10e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:38.431114 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ebaf047e-93d2-4e40-869e-33b3bfb7c10e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:38.754348 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ebaf047e-93d2-4e40-869e-33b3bfb7c10e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:38.767777 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ebaf047e-93d2-4e40-869e-33b3bfb7c10e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:38.772170 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ebaf047e-93d2-4e40-869e-33b3bfb7c10e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:38.775631 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ebaf047e-93d2-4e40-869e-33b3bfb7c10e tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.363299 Aug 03 10:50:38.792898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 446/874] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:38 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:39.800920 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-398c2beb-3a67-4954-88be-e57abb921036 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:39.802218 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-398c2beb-3a67-4954-88be-e57abb921036 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:39.817941 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-398c2beb-3a67-4954-88be-e57abb921036 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:39.820363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-398c2beb-3a67-4954-88be-e57abb921036 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:39.823038 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-398c2beb-3a67-4954-88be-e57abb921036 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:39.823664 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-398c2beb-3a67-4954-88be-e57abb921036 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:40.075563 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-398c2beb-3a67-4954-88be-e57abb921036 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:40.094902 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-398c2beb-3a67-4954-88be-e57abb921036 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:40.100589 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-398c2beb-3a67-4954-88be-e57abb921036 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:40.102358 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-398c2beb-3a67-4954-88be-e57abb921036 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.305772 Aug 03 10:50:40.103136 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 429/875] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:39 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:41.130571 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a4524296-3b4c-4450-93f5-0548021c9108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:41.131358 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-a4524296-3b4c-4450-93f5-0548021c9108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:41.141402 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a4524296-3b4c-4450-93f5-0548021c9108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:41.142613 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a4524296-3b4c-4450-93f5-0548021c9108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:41.143856 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a4524296-3b4c-4450-93f5-0548021c9108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:41.144522 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a4524296-3b4c-4450-93f5-0548021c9108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:41.227195 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f166c7eb-f97d-4922-b0dc-ef744db3d76e tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Action: 'create', calling method: .version_select at 0x7fbd10514d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1771934992"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:50:41.412455 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-a4524296-3b4c-4450-93f5-0548021c9108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:41.426160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-a4524296-3b4c-4450-93f5-0548021c9108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:41.432227 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-a4524296-3b4c-4450-93f5-0548021c9108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:41.433493 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-a4524296-3b4c-4450-93f5-0548021c9108 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.307311 Aug 03 10:50:41.445540 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 430/876] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:41 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:41.802918 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f166c7eb-f97d-4922-b0dc-ef744db3d76e tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.799457 Aug 03 10:50:41.803844 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 447/877] 10.222.0.47 () {60 vars in 1155 bytes} [Wed Aug 3 10:50:41 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 801 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 03 10:50:41.816382 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-32a1f5d7-80c1-46b8-bd1e-bf3e14a64eb6 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd105afee0>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:41.949808 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-32a1f5d7-80c1-46b8-bd1e-bf3e14a64eb6 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76" status: 200 len: 345 microversion: 2.1 time: 0.137180 Aug 03 10:50:41.951054 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 431/878] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 3 10:50:41 2022] GET /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76 => generated 345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:42.463149 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1230e86a-cb4c-4c90-a2a2-fc6863ea0957 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:42.473838 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1230e86a-cb4c-4c90-a2a2-fc6863ea0957 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:42.486569 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:50:42.493660 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1230e86a-cb4c-4c90-a2a2-fc6863ea0957 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:42.494556 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1230e86a-cb4c-4c90-a2a2-fc6863ea0957 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:42.495811 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1230e86a-cb4c-4c90-a2a2-fc6863ea0957 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:42.497540 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1230e86a-cb4c-4c90-a2a2-fc6863ea0957 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:42.770020 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1230e86a-cb4c-4c90-a2a2-fc6863ea0957 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:42.791168 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1230e86a-cb4c-4c90-a2a2-fc6863ea0957 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:42.796653 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1230e86a-cb4c-4c90-a2a2-fc6863ea0957 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:42.806172 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1230e86a-cb4c-4c90-a2a2-fc6863ea0957 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.348545 Aug 03 10:50:42.806784 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 448/879] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:42 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:50:42.968875 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-0bb0f350-7fd6-4ae9-a9a3-4933ff9ee0fe tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd10505dc0>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:43.055033 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-0bb0f350-7fd6-4ae9-a9a3-4933ff9ee0fe tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76" status: 200 len: 346 microversion: 2.1 time: 0.093209 Aug 03 10:50:43.056324 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 432/880] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 3 10:50:42 2022] GET /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76 => generated 346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:43.074724 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b736ca72-aab8-4d4e-88f2-2c5dac366568 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Action: 'create', calling method: .version_select at 0x7fbd1061fe50>, body: {"snapshot": {"volume_id": "99d243d7-0303-4450-a02b-2e3435a90a76", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1138121135"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:50:43.304222 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b736ca72-aab8-4d4e-88f2-2c5dac366568 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.239082 Aug 03 10:50:43.305777 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 449/881] 10.222.0.47 () {60 vars in 1162 bytes} [Wed Aug 3 10:50:43 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:50:43.316632 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c7a89340-549b-4c41-9389-ce1575be1e63 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd10500310>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:43.370382 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c7a89340-549b-4c41-9389-ce1575be1e63 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320" status: 200 len: 287 microversion: 2.1 time: 0.057119 Aug 03 10:50:43.371569 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 433/882] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 3 10:50:43 2022] GET /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:43.387488 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0e3c31e8-55fd-4be1-b610-30380163b125 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd10514790>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:43.421436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0e3c31e8-55fd-4be1-b610-30380163b125 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.039224 Aug 03 10:50:43.422031 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 450/883] 10.222.0.47 () {58 vars in 1140 bytes} [Wed Aug 3 10:50:43 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:43.434614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5fe0bd5e-b2b3-4858-a67d-9af7923a04ce tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd1053e280>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:43.470705 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5fe0bd5e-b2b3-4858-a67d-9af7923a04ce tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320" status: 200 len: 287 microversion: 2.1 time: 0.041228 Aug 03 10:50:43.472764 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 434/884] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 3 10:50:43 2022] GET /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:43.834192 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-85f015ac-e345-49d5-9d09-51786180411f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:43.834813 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-85f015ac-e345-49d5-9d09-51786180411f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:43.842049 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-85f015ac-e345-49d5-9d09-51786180411f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:43.842837 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-85f015ac-e345-49d5-9d09-51786180411f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:43.844149 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-85f015ac-e345-49d5-9d09-51786180411f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:43.844778 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-85f015ac-e345-49d5-9d09-51786180411f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:44.064896 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-85f015ac-e345-49d5-9d09-51786180411f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:44.076052 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-85f015ac-e345-49d5-9d09-51786180411f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:44.077931 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-85f015ac-e345-49d5-9d09-51786180411f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:44.079500 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-85f015ac-e345-49d5-9d09-51786180411f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.250519 Aug 03 10:50:44.080711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 451/885] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:43 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:44.491650 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d1266d70-34c6-465f-8ff9-ff024af411c3 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd105af670>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:44.577346 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d1266d70-34c6-465f-8ff9-ff024af411c3 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320" status: 200 len: 287 microversion: 2.1 time: 0.093925 Aug 03 10:50:44.578539 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 435/886] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 3 10:50:44 2022] GET /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:44.667984 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-b1f61121-8eb8-4ec4-a611-55f377e394e2 req-b4e1e2ef-2930-4e9e-8f6e-42903ead9cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cbe8d4-0681-4b94-a774-1f0067f69263", "name": "network-vif-plugged", "status": "completed", "tag": "5c7bb60f-6fc3-4d3d-bda1-d77d9a5e91fb"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:50:44.691272 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-b1f61121-8eb8-4ec4-a611-55f377e394e2 req-b4e1e2ef-2930-4e9e-8f6e-42903ead9cd9 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:44.691727 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-b1f61121-8eb8-4ec4-a611-55f377e394e2 req-b4e1e2ef-2930-4e9e-8f6e-42903ead9cd9 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:44.717845 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-b1f61121-8eb8-4ec4-a611-55f377e394e2 req-b4e1e2ef-2930-4e9e-8f6e-42903ead9cd9 service nova] Creating event network-vif-plugged:5c7bb60f-6fc3-4d3d-bda1-d77d9a5e91fb for instance 99cbe8d4-0681-4b94-a774-1f0067f69263 on hv-cinder-85083 Aug 03 10:50:44.725646 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-b1f61121-8eb8-4ec4-a611-55f377e394e2 req-b4e1e2ef-2930-4e9e-8f6e-42903ead9cd9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062268 Aug 03 10:50:44.726969 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 452/887] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:45.105887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ee4a7f01-614a-4765-ac9e-2796d38ac087 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:45.106506 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-ee4a7f01-614a-4765-ac9e-2796d38ac087 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:45.117139 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ee4a7f01-614a-4765-ac9e-2796d38ac087 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:45.118687 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ee4a7f01-614a-4765-ac9e-2796d38ac087 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:45.119678 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ee4a7f01-614a-4765-ac9e-2796d38ac087 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:45.120378 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ee4a7f01-614a-4765-ac9e-2796d38ac087 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:45.308420 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-ee4a7f01-614a-4765-ac9e-2796d38ac087 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:45.317642 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-ee4a7f01-614a-4765-ac9e-2796d38ac087 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:45.322080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-ee4a7f01-614a-4765-ac9e-2796d38ac087 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:45.324492 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ee4a7f01-614a-4765-ac9e-2796d38ac087 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.224196 Aug 03 10:50:45.329149 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 436/888] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:45 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:45.594384 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7c61fb60-5b0b-40ba-967a-f8e30efc22f5 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd105ab0d0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:45.636747 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7c61fb60-5b0b-40ba-967a-f8e30efc22f5 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320" status: 200 len: 287 microversion: 2.1 time: 0.049065 Aug 03 10:50:45.637794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 453/889] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 3 10:50:45 2022] GET /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:46.358131 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-df1a06e3-ba85-471a-b3d3-ba5221cc45fa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:46.358746 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-df1a06e3-ba85-471a-b3d3-ba5221cc45fa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:46.374066 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-df1a06e3-ba85-471a-b3d3-ba5221cc45fa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:46.374715 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-df1a06e3-ba85-471a-b3d3-ba5221cc45fa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:46.375671 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-df1a06e3-ba85-471a-b3d3-ba5221cc45fa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:46.376272 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-df1a06e3-ba85-471a-b3d3-ba5221cc45fa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:46.660770 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-adbc2ebc-679b-47eb-b5bf-e29b89e5ba04 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd10514670>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:46.695678 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-df1a06e3-ba85-471a-b3d3-ba5221cc45fa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:46.709772 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-df1a06e3-ba85-471a-b3d3-ba5221cc45fa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:46.714320 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-df1a06e3-ba85-471a-b3d3-ba5221cc45fa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:46.715546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-df1a06e3-ba85-471a-b3d3-ba5221cc45fa tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.361690 Aug 03 10:50:46.716481 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 437/890] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:46 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:46.733055 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-adbc2ebc-679b-47eb-b5bf-e29b89e5ba04 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320" status: 200 len: 288 microversion: 2.1 time: 0.087139 Aug 03 10:50:46.740144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 454/891] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 3 10:50:46 2022] GET /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320 => generated 288 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:46.748101 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9d80472a-ecc2-4df0-8a0c-eb369e70104b tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd10520c10>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:46.890854 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9d80472a-ecc2-4df0-8a0c-eb369e70104b tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320" status: 202 len: 0 microversion: 2.1 time: 0.149649 Aug 03 10:50:46.891502 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 438/892] 10.222.0.47 () {58 vars in 1254 bytes} [Wed Aug 3 10:50:46 2022] DELETE /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:50:46.900766 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-48cc76e2-86e9-4024-9a3b-c2734a3cecdf tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd105af820>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:46.970427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-48cc76e2-86e9-4024-9a3b-c2734a3cecdf tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320" status: 200 len: 287 microversion: 2.1 time: 0.074466 Aug 03 10:50:46.974257 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 455/893] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 3 10:50:46 2022] GET /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:50:47.745169 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3f33d008-8ef0-49b8-9015-a81f65075bfe tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:47.746601 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3f33d008-8ef0-49b8-9015-a81f65075bfe tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:47.754457 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3f33d008-8ef0-49b8-9015-a81f65075bfe tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:47.755367 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3f33d008-8ef0-49b8-9015-a81f65075bfe tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:47.756240 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3f33d008-8ef0-49b8-9015-a81f65075bfe tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:47.757066 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3f33d008-8ef0-49b8-9015-a81f65075bfe tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:47.959286 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3f33d008-8ef0-49b8-9015-a81f65075bfe tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:47.974710 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3f33d008-8ef0-49b8-9015-a81f65075bfe tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:47.976233 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3f33d008-8ef0-49b8-9015-a81f65075bfe tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:47.978009 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3f33d008-8ef0-49b8-9015-a81f65075bfe tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.239619 Aug 03 10:50:47.978572 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 439/894] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:47 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:47.987845 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-25fff6cd-1fd2-489e-a6f2-0f893317d540 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd106ddd30>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:48.050989 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-25fff6cd-1fd2-489e-a6f2-0f893317d540 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] HTTP exception thrown: Snapshot 71867947-d599-4b36-b56b-98d4a1928320 could not be found. Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-25fff6cd-1fd2-489e-a6f2-0f893317d540 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Request method failure captured: Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320 HTTP/1.1 Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lMAJv0asG5NmVUB73NFfMLWfsD9NP1ae3DvZStsTI-0iZwtx-DT-H_4DbsqPLuew7Q1URdFoDk4ss9GOFt3V5pjHEq1toEMAThqUftNHMPGRWuHslUUKwUtNEb5kZ0c1X1x31TlYzNPGmmwGjcC9d0Z_GlOTCR9fVo78p3LTr5kGLA Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 9559a93e928e48108b818ac3bb239e48 Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-408231758 Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:50:48.054498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:50:48.057185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9559a93e928e48108b818ac3bb239e48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9559a93e928e48108b818ac3bb239e48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9559a93e928e48108b818ac3bb239e48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9559a93e928e48108b818ac3bb239e48", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:48.057185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesSnapshotsTestJSON-408231758 Aug 03 10:50:48.057185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 9559a93e928e48108b818ac3bb239e48 Aug 03 10:50:48.057185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-408231758 Aug 03 10:50:48.057185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesSnapshotsTestJSON-408231758-project Aug 03 10:50:48.057185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:50:48.057185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:50:48.057185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 88cfa5e4719a4eeb94ac3c2175f680ed Aug 03 10:50:48.057185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesSnapshotsTestJSON-408231758-project Aug 03 10:50:48.057185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: Aug 03 10:50:48.057185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Snapshot 71867947-d599-4b36-b56b-98d4a1928320 could not be found. Aug 03 10:50:48.057185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': '71867947-d599-4b36-b56b-98d4a1928320'} Aug 03 10:50:48.057185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 71867947-d599-4b36-b56b-98d4a1928320 could not be found. (HTTP 404) (Request-ID: req-a4419925-212c-4f87-93a4-d8ab628920d0) Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:48.058436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 10:50:48.060085 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 71867947-d599-4b36-b56b-98d4a1928320 could not be found. Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 03 10:50:48.062037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:48.065256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 71867947-d599-4b36-b56b-98d4a1928320 could not be found. Aug 03 10:50:48.065256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:48.065256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:48.065256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:48.065256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:48.065256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:48.065256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:48.065256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:48.065256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:48.065256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 71867947-d599-4b36-b56b-98d4a1928320 could not be found. Aug 03 10:50:48.065256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:48.068392 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-25fff6cd-1fd2-489e-a6f2-0f893317d540 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Returning 404 to user: Snapshot 71867947-d599-4b36-b56b-98d4a1928320 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:48.068392 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-25fff6cd-1fd2-489e-a6f2-0f893317d540 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320" status: 404 len: 111 microversion: 2.1 time: 0.084574 Aug 03 10:50:48.068392 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 456/895] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 3 10:50:47 2022] GET /compute/v2.1/os-snapshots/71867947-d599-4b36-b56b-98d4a1928320 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:48.078133 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-dca29213-cddf-4d4f-b8a1-911ffcac07fa tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd104edf70>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:48.166323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-dca29213-cddf-4d4f-b8a1-911ffcac07fa tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76" status: 202 len: 0 microversion: 2.1 time: 0.091873 Aug 03 10:50:48.171060 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 440/896] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 3 10:50:48 2022] DELETE /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:50:48.177933 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1082aa83-85da-4e7a-9d29-2da07213fda7 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd10514670>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:48.281825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1082aa83-85da-4e7a-9d29-2da07213fda7 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76" status: 200 len: 345 microversion: 2.1 time: 0.109599 Aug 03 10:50:48.283933 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 457/897] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 3 10:50:48 2022] GET /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76 => generated 345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:50:49.006716 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-04505818-d3f6-431e-915d-cea17198f55b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:49.007355 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-04505818-d3f6-431e-915d-cea17198f55b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:49.015885 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-04505818-d3f6-431e-915d-cea17198f55b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:49.017777 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-04505818-d3f6-431e-915d-cea17198f55b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:49.023637 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-04505818-d3f6-431e-915d-cea17198f55b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:49.027093 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-04505818-d3f6-431e-915d-cea17198f55b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:49.297072 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4306153f-323e-4da0-8a41-bcfc5ddaa30a tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd10681040>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:49.330075 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-04505818-d3f6-431e-915d-cea17198f55b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:49.341217 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-4306153f-323e-4da0-8a41-bcfc5ddaa30a tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] HTTP exception thrown: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4306153f-323e-4da0-8a41-bcfc5ddaa30a tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Request method failure captured: Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76 HTTP/1.1 Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lMAJv0asG5NmVUB73NFfMLWfsD9NP1ae3DvZStsTI-0iZwtx-DT-H_4DbsqPLuew7Q1URdFoDk4ss9GOFt3V5pjHEq1toEMAThqUftNHMPGRWuHslUUKwUtNEb5kZ0c1X1x31TlYzNPGmmwGjcC9d0Z_GlOTCR9fVo78p3LTr5kGLA Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 9559a93e928e48108b818ac3bb239e48 Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-408231758 Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:50:49.343898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:50:49.345284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9559a93e928e48108b818ac3bb239e48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9559a93e928e48108b818ac3bb239e48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9559a93e928e48108b818ac3bb239e48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9559a93e928e48108b818ac3bb239e48", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:49.345284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesSnapshotsTestJSON-408231758 Aug 03 10:50:49.345284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 9559a93e928e48108b818ac3bb239e48 Aug 03 10:50:49.345284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-408231758 Aug 03 10:50:49.345284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesSnapshotsTestJSON-408231758-project Aug 03 10:50:49.345284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:50:49.345284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:50:49.345284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 88cfa5e4719a4eeb94ac3c2175f680ed Aug 03 10:50:49.345284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesSnapshotsTestJSON-408231758-project Aug 03 10:50:49.345284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: Aug 03 10:50:49.345284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. Aug 03 10:50:49.345284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': '99d243d7-0303-4450-a02b-2e3435a90a76'} Aug 03 10:50:49.345284 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. (HTTP 404) (Request-ID: req-4937615f-df4d-4f8e-ae0f-3ac5ef6a7f69) Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:49.346123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 10:50:49.347259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 10:50:49.348427 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:49.350678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. Aug 03 10:50:49.350678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.350678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:49.350678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.350678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:49.350678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:49.350678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:49.350678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:49.350678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:49.350678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. Aug 03 10:50:49.350678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.352478 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-04505818-d3f6-431e-915d-cea17198f55b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:49.352478 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-04505818-d3f6-431e-915d-cea17198f55b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:49.352478 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-04505818-d3f6-431e-915d-cea17198f55b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1729 microversion: 2.20 time: 0.344640 Aug 03 10:50:49.355098 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4306153f-323e-4da0-8a41-bcfc5ddaa30a tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Returning 404 to user: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:49.356314 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4306153f-323e-4da0-8a41-bcfc5ddaa30a tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76" status: 404 len: 109 microversion: 2.1 time: 0.062871 Aug 03 10:50:49.357612 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 458/898] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 3 10:50:49 2022] GET /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 10:50:49.367413 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 441/899] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:49 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1729 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:49.371934 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-62cba048-0306-4ae3-b603-fd797d9b48dc tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd10524790>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:49.417545 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-62cba048-0306-4ae3-b603-fd797d9b48dc tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] HTTP exception thrown: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-62cba048-0306-4ae3-b603-fd797d9b48dc tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Request method failure captured: Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: DELETE /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76 HTTP/1.1 Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lMAJv0asG5NmVUB73NFfMLWfsD9NP1ae3DvZStsTI-0iZwtx-DT-H_4DbsqPLuew7Q1URdFoDk4ss9GOFt3V5pjHEq1toEMAThqUftNHMPGRWuHslUUKwUtNEb5kZ0c1X1x31TlYzNPGmmwGjcC9d0Z_GlOTCR9fVo78p3LTr5kGLA Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 9559a93e928e48108b818ac3bb239e48 Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-408231758 Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:50:49.419836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:50:49.421155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9559a93e928e48108b818ac3bb239e48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9559a93e928e48108b818ac3bb239e48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9559a93e928e48108b818ac3bb239e48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9559a93e928e48108b818ac3bb239e48", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:49.421155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesSnapshotsTestJSON-408231758 Aug 03 10:50:49.421155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 9559a93e928e48108b818ac3bb239e48 Aug 03 10:50:49.421155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-408231758 Aug 03 10:50:49.421155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesSnapshotsTestJSON-408231758-project Aug 03 10:50:49.421155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:50:49.421155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:50:49.421155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 88cfa5e4719a4eeb94ac3c2175f680ed Aug 03 10:50:49.421155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesSnapshotsTestJSON-408231758-project Aug 03 10:50:49.421155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: Aug 03 10:50:49.421155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. Aug 03 10:50:49.421155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': '99d243d7-0303-4450-a02b-2e3435a90a76'} Aug 03 10:50:49.421155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. (HTTP 404) (Request-ID: req-ca3f80f1-bfaf-43f3-bb6f-6311ee0858af) Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:49.421981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 10:50:49.423112 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 10:50:49.424241 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:49.425349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. Aug 03 10:50:49.425349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.425349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:49.425349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.425349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:49.425349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:49.425349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:49.425349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:49.425349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:49.425349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. Aug 03 10:50:49.425349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.428460 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-62cba048-0306-4ae3-b603-fd797d9b48dc tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Returning 404 to user: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:49.429573 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-62cba048-0306-4ae3-b603-fd797d9b48dc tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76" status: 404 len: 109 microversion: 2.1 time: 0.065929 Aug 03 10:50:49.431221 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 459/900] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 3 10:50:49 2022] DELETE /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:49.441885 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c8b13b22-a007-44a5-9326-433f85710632 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Calling method '.version_select at 0x7fbd104ed0d0>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:49.487269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-c8b13b22-a007-44a5-9326-433f85710632 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] HTTP exception thrown: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c8b13b22-a007-44a5-9326-433f85710632 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Request method failure captured: Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76 HTTP/1.1 Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lMAJv0asG5NmVUB73NFfMLWfsD9NP1ae3DvZStsTI-0iZwtx-DT-H_4DbsqPLuew7Q1URdFoDk4ss9GOFt3V5pjHEq1toEMAThqUftNHMPGRWuHslUUKwUtNEb5kZ0c1X1x31TlYzNPGmmwGjcC9d0Z_GlOTCR9fVo78p3LTr5kGLA Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: 9559a93e928e48108b818ac3bb239e48 Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-408231758 Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:50:49.489802 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:50:49.491363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9559a93e928e48108b818ac3bb239e48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9559a93e928e48108b818ac3bb239e48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9559a93e928e48108b818ac3bb239e48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9559a93e928e48108b818ac3bb239e48", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:49.491363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-VolumesSnapshotsTestJSON-408231758 Aug 03 10:50:49.491363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: 9559a93e928e48108b818ac3bb239e48 Aug 03 10:50:49.491363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-408231758 Aug 03 10:50:49.491363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-VolumesSnapshotsTestJSON-408231758-project Aug 03 10:50:49.491363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:50:49.491363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:50:49.491363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 88cfa5e4719a4eeb94ac3c2175f680ed Aug 03 10:50:49.491363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-VolumesSnapshotsTestJSON-408231758-project Aug 03 10:50:49.491363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: Aug 03 10:50:49.491363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. Aug 03 10:50:49.491363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '99d243d7-0303-4450-a02b-2e3435a90a76'} Aug 03 10:50:49.491363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. (HTTP 404) (Request-ID: req-41c3d21d-43be-443f-b0c7-9bb87b7b4f08) Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:49.492296 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 10:50:49.494028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 10:50:49.495126 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:49.496228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. Aug 03 10:50:49.496228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.496228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:49.496228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.496228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:49.496228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:49.496228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:49.496228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:49.496228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:49.496228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. Aug 03 10:50:49.496228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:49.501026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c8b13b22-a007-44a5-9326-433f85710632 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] Returning 404 to user: Volume 99d243d7-0303-4450-a02b-2e3435a90a76 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:49.501026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c8b13b22-a007-44a5-9326-433f85710632 tempest-VolumesSnapshotsTestJSON-408231758 tempest-VolumesSnapshotsTestJSON-408231758-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76" status: 404 len: 109 microversion: 2.1 time: 0.064870 Aug 03 10:50:49.501598 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 442/901] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 3 10:50:49 2022] GET /compute/v2.1/os-volumes/99d243d7-0303-4450-a02b-2e3435a90a76 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:50.374751 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7c9d8009-3a7b-455b-80f0-de0e6e0d5918 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:50.375530 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7c9d8009-3a7b-455b-80f0-de0e6e0d5918 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:50:50.386349 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7c9d8009-3a7b-455b-80f0-de0e6e0d5918 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:50.387296 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7c9d8009-3a7b-455b-80f0-de0e6e0d5918 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:50.388476 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7c9d8009-3a7b-455b-80f0-de0e6e0d5918 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:50:50.389319 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7c9d8009-3a7b-455b-80f0-de0e6e0d5918 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:50:50.447567 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:50:50.719279 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7c9d8009-3a7b-455b-80f0-de0e6e0d5918 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:50.729979 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7c9d8009-3a7b-455b-80f0-de0e6e0d5918 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:50.735326 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7c9d8009-3a7b-455b-80f0-de0e6e0d5918 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:50:50.738562 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7c9d8009-3a7b-455b-80f0-de0e6e0d5918 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1716 microversion: 2.20 time: 0.370341 Aug 03 10:50:50.741934 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 460/902] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:50:50 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1716 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:50:51.855903 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ffc7c2fa-af0a-43ef-a299-8823c474d3e4 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Action: 'create', calling method: .version_select at 0x7fbd1053e790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-731918174", "metadata": {"Type": "work"}}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ffc7c2fa-af0a-43ef-a299-8823c474d3e4 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Request method failure captured: Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 121 Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lML4DiVGFHrRaQ3wI-MFT-lJ4BkK996-ftjt8nWXSRLUDIdXNkde8r6mxhQUZwgayihtYh-HT3yQeOStUP84Q_gbGbwEmGO1Web_nuvPCdxNdvIklkYUIO6p-8v9ZgGqsKNZW2PI6zF4hafJ4TIMRjVKFtWhTSRbFWEMZGU8BYRXyw Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: ee44e977cb7e4a2d807ad695302472bf Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:50:51.870028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:50:51.871441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ee44e977cb7e4a2d807ad695302472bf", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:51.871441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:51.871441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: ee44e977cb7e4a2d807ad695302472bf Aug 03 10:50:51.871441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:51.871441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-VolumesNegativeTest-1673038425-project Aug 03 10:50:51.871441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:50:51.871441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:50:51.871441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: e97a9a7a3172412f9d67af6537670016 Aug 03 10:50:51.871441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-VolumesNegativeTest-1673038425-project Aug 03 10:50:51.871441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Aug 03 10:50:51.871441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-731918174", "metadata": {"Type": "work"}}} Aug 03 10:50:51.871441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: Aug 03 10:50:51.871441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-731918174', 'metadata': {'Type': 'work'}}}} Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise error Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi '#$%' Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:51.872282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 10:50:51.875040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 10:50:51.876611 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 10:50:51.876611 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.880309 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ffc7c2fa-af0a-43ef-a299-8823c474d3e4 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:51.881901 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ffc7c2fa-af0a-43ef-a299-8823c474d3e4 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.182207 Aug 03 10:50:51.883094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 443/903] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Aug 3 10:50:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 10:50:51.895973 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6ff980a3-cad1-4650-9298-249e5dbfcf60 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Action: 'create', calling method: .version_select at 0x7fbd105249d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1979327197", "metadata": {"Type": "work"}}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6ff980a3-cad1-4650-9298-249e5dbfcf60 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Request method failure captured: Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 120 Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lML4DiVGFHrRaQ3wI-MFT-lJ4BkK996-ftjt8nWXSRLUDIdXNkde8r6mxhQUZwgayihtYh-HT3yQeOStUP84Q_gbGbwEmGO1Web_nuvPCdxNdvIklkYUIO6p-8v9ZgGqsKNZW2PI6zF4hafJ4TIMRjVKFtWhTSRbFWEMZGU8BYRXyw Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: ee44e977cb7e4a2d807ad695302472bf Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:50:51.937007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:50:51.938641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ee44e977cb7e4a2d807ad695302472bf", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:51.938641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:51.938641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: ee44e977cb7e4a2d807ad695302472bf Aug 03 10:50:51.938641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:51.938641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesNegativeTest-1673038425-project Aug 03 10:50:51.938641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:50:51.938641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:50:51.938641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: e97a9a7a3172412f9d67af6537670016 Aug 03 10:50:51.938641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesNegativeTest-1673038425-project Aug 03 10:50:51.938641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Aug 03 10:50:51.938641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1979327197", "metadata": {"Type": "work"}}} Aug 03 10:50:51.938641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: Aug 03 10:50:51.938641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1979327197', 'metadata': {'Type': 'work'}}}} Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise error Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi '0' Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:51.943036 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 10:50:51.944654 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 10:50:51.946877 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 10:50:51.946877 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.946877 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6ff980a3-cad1-4650-9298-249e5dbfcf60 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:51.946877 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6ff980a3-cad1-4650-9298-249e5dbfcf60 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.049510 Aug 03 10:50:51.946877 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 461/904] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Aug 3 10:50:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 10:50:51.954145 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b4fb6e9a-3143-464e-9465-23e6045c648e tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Action: 'create', calling method: .version_select at 0x7fbd105af700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-681432963", "metadata": {"Type": "work"}}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b4fb6e9a-3143-464e-9465-23e6045c648e tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Request method failure captured: Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 118 Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lML4DiVGFHrRaQ3wI-MFT-lJ4BkK996-ftjt8nWXSRLUDIdXNkde8r6mxhQUZwgayihtYh-HT3yQeOStUP84Q_gbGbwEmGO1Web_nuvPCdxNdvIklkYUIO6p-8v9ZgGqsKNZW2PI6zF4hafJ4TIMRjVKFtWhTSRbFWEMZGU8BYRXyw Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: ee44e977cb7e4a2d807ad695302472bf Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:50:51.958269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:50:51.959728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ee44e977cb7e4a2d807ad695302472bf", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:51.959728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:51.959728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: ee44e977cb7e4a2d807ad695302472bf Aug 03 10:50:51.959728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:51.959728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-VolumesNegativeTest-1673038425-project Aug 03 10:50:51.959728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:50:51.959728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:50:51.959728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: e97a9a7a3172412f9d67af6537670016 Aug 03 10:50:51.959728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-VolumesNegativeTest-1673038425-project Aug 03 10:50:51.959728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Aug 03 10:50:51.959728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-681432963", "metadata": {"Type": "work"}}} Aug 03 10:50:51.959728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: Aug 03 10:50:51.959728 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-681432963', 'metadata': {'Type': 'work'}}}} Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise error Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi '' Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:51.960823 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 10:50:51.962888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 10:50:51.964026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 10:50:51.964026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:51.964026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b4fb6e9a-3143-464e-9465-23e6045c648e tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:51.964026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b4fb6e9a-3143-464e-9465-23e6045c648e tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015327 Aug 03 10:50:51.964026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 444/905] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Aug 3 10:50:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 10:50:51.978047 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-21dfb2b7-3e83-45db-85e4-a16c5e84f559 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Calling method '.version_select at 0x7fbd104ebf70>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:52.009128 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-21dfb2b7-3e83-45db-85e4-a16c5e84f559 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] HTTP exception thrown: Volume tempest-invalid-1912646559 could not be found. Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-21dfb2b7-3e83-45db-85e4-a16c5e84f559 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Request method failure captured: Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1912646559 HTTP/1.1 Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lML4DiVGFHrRaQ3wI-MFT-lJ4BkK996-ftjt8nWXSRLUDIdXNkde8r6mxhQUZwgayihtYh-HT3yQeOStUP84Q_gbGbwEmGO1Web_nuvPCdxNdvIklkYUIO6p-8v9ZgGqsKNZW2PI6zF4hafJ4TIMRjVKFtWhTSRbFWEMZGU8BYRXyw Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: ee44e977cb7e4a2d807ad695302472bf Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:50:52.011885 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:50:52.013428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ee44e977cb7e4a2d807ad695302472bf", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:52.013428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:52.013428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: ee44e977cb7e4a2d807ad695302472bf Aug 03 10:50:52.013428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:52.013428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesNegativeTest-1673038425-project Aug 03 10:50:52.013428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:50:52.013428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:50:52.013428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: e97a9a7a3172412f9d67af6537670016 Aug 03 10:50:52.013428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesNegativeTest-1673038425-project Aug 03 10:50:52.013428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: Aug 03 10:50:52.013428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Volume tempest-invalid-1912646559 could not be found. Aug 03 10:50:52.013428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': 'tempest-invalid-1912646559'} Aug 03 10:50:52.013428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1912646559 could not be found. (HTTP 404) (Request-ID: req-d555a4dd-5754-42f2-bd8d-42b64a3f4e7d) Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:52.014474 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 10:50:52.015910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1912646559 could not be found. Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:52.017260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1912646559 could not be found. Aug 03 10:50:52.018802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.018802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:52.018802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.018802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:52.018802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:52.018802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:52.018802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:52.018802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:52.018802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1912646559 could not be found. Aug 03 10:50:52.018802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.018802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-21dfb2b7-3e83-45db-85e4-a16c5e84f559 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Returning 404 to user: Volume tempest-invalid-1912646559 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:52.018802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-21dfb2b7-3e83-45db-85e4-a16c5e84f559 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1912646559" status: 404 len: 99 microversion: 2.1 time: 0.040300 Aug 03 10:50:52.018802 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 462/906] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Aug 3 10:50:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1912646559 => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 10:50:52.023699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-0cc9f313-a902-4f0c-b3a2-5b75d9b426b1 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004345 Aug 03 10:50:52.024242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 445/907] 10.222.0.47 () {58 vars in 1140 bytes} [Wed Aug 3 10:50:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 10:50:52.033699 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c9c0e447-b55e-45f4-a5a5-88d467947cdb tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004004 Aug 03 10:50:52.034147 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 463/908] 10.222.0.47 () {58 vars in 1137 bytes} [Wed Aug 3 10:50:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 10:50:52.045033 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1706e678-7097-498b-8536-84f68639f25e tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Calling method '.version_select at 0x7fbd1053e940>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:52.077587 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-1706e678-7097-498b-8536-84f68639f25e tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] HTTP exception thrown: Volume 04389b93-4b4b-46c4-bd91-ae536ae1d76f could not be found. Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1706e678-7097-498b-8536-84f68639f25e tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Request method failure captured: Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: DELETE /compute/v2.1/os-volumes/04389b93-4b4b-46c4-bd91-ae536ae1d76f HTTP/1.1 Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lML4DiVGFHrRaQ3wI-MFT-lJ4BkK996-ftjt8nWXSRLUDIdXNkde8r6mxhQUZwgayihtYh-HT3yQeOStUP84Q_gbGbwEmGO1Web_nuvPCdxNdvIklkYUIO6p-8v9ZgGqsKNZW2PI6zF4hafJ4TIMRjVKFtWhTSRbFWEMZGU8BYRXyw Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: ee44e977cb7e4a2d807ad695302472bf Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:50:52.079726 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:50:52.081364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ee44e977cb7e4a2d807ad695302472bf", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:52.081364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:52.081364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: ee44e977cb7e4a2d807ad695302472bf Aug 03 10:50:52.081364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:52.081364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-VolumesNegativeTest-1673038425-project Aug 03 10:50:52.081364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:50:52.081364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:50:52.081364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: e97a9a7a3172412f9d67af6537670016 Aug 03 10:50:52.081364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-VolumesNegativeTest-1673038425-project Aug 03 10:50:52.081364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: Aug 03 10:50:52.081364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Volume 04389b93-4b4b-46c4-bd91-ae536ae1d76f could not be found. Aug 03 10:50:52.081364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '04389b93-4b4b-46c4-bd91-ae536ae1d76f'} Aug 03 10:50:52.081364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 04389b93-4b4b-46c4-bd91-ae536ae1d76f could not be found. (HTTP 404) (Request-ID: req-19d275ad-fa67-4073-a95f-6042e5d7c990) Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:52.082363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 10:50:52.083698 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 04389b93-4b4b-46c4-bd91-ae536ae1d76f could not be found. Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 10:50:52.085080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:52.087007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 04389b93-4b4b-46c4-bd91-ae536ae1d76f could not be found. Aug 03 10:50:52.087007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.087007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:52.087007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.087007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:52.087007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:52.087007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:52.087007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:52.087007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:52.087007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 04389b93-4b4b-46c4-bd91-ae536ae1d76f could not be found. Aug 03 10:50:52.087007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.087007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1706e678-7097-498b-8536-84f68639f25e tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Returning 404 to user: Volume 04389b93-4b4b-46c4-bd91-ae536ae1d76f could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:52.087007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1706e678-7097-498b-8536-84f68639f25e tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/04389b93-4b4b-46c4-bd91-ae536ae1d76f" status: 404 len: 109 microversion: 2.1 time: 0.041858 Aug 03 10:50:52.087007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 446/909] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 3 10:50:52 2022] DELETE /compute/v2.1/os-volumes/04389b93-4b4b-46c4-bd91-ae536ae1d76f => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:50:52.100617 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-14f13e8d-ab4e-487f-9984-68e2200ab446 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Calling method '.version_select at 0x7fbd10584d30>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:50:52.137034 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-14f13e8d-ab4e-487f-9984-68e2200ab446 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] HTTP exception thrown: Volume f891bab8-fdeb-424b-845f-80c2330032d2 could not be found. Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-14f13e8d-ab4e-487f-9984-68e2200ab446 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Request method failure captured: Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/os-volumes/f891bab8-fdeb-424b-845f-80c2330032d2 HTTP/1.1 Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lML4DiVGFHrRaQ3wI-MFT-lJ4BkK996-ftjt8nWXSRLUDIdXNkde8r6mxhQUZwgayihtYh-HT3yQeOStUP84Q_gbGbwEmGO1Web_nuvPCdxNdvIklkYUIO6p-8v9ZgGqsKNZW2PI6zF4hafJ4TIMRjVKFtWhTSRbFWEMZGU8BYRXyw Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: ee44e977cb7e4a2d807ad695302472bf Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:50:52.139240 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:50:52.140824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ee44e977cb7e4a2d807ad695302472bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ee44e977cb7e4a2d807ad695302472bf", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:50:52.140824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:52.140824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: ee44e977cb7e4a2d807ad695302472bf Aug 03 10:50:52.140824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesNegativeTest-1673038425 Aug 03 10:50:52.140824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesNegativeTest-1673038425-project Aug 03 10:50:52.140824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:50:52.140824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:50:52.140824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: e97a9a7a3172412f9d67af6537670016 Aug 03 10:50:52.140824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesNegativeTest-1673038425-project Aug 03 10:50:52.140824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: Aug 03 10:50:52.140824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Volume f891bab8-fdeb-424b-845f-80c2330032d2 could not be found. Aug 03 10:50:52.140824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': 'f891bab8-fdeb-424b-845f-80c2330032d2'} Aug 03 10:50:52.140824 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f891bab8-fdeb-424b-845f-80c2330032d2 could not be found. (HTTP 404) (Request-ID: req-e435ed31-c69c-48fd-8f9d-b0b40307122b) Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:52.141809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 10:50:52.143144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f891bab8-fdeb-424b-845f-80c2330032d2 could not be found. Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 10:50:52.144538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:50:52.145922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f891bab8-fdeb-424b-845f-80c2330032d2 could not be found. Aug 03 10:50:52.145922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.145922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:50:52.145922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.145922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:50:52.145922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:50:52.145922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:50:52.145922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:50:52.145922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:50:52.145922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f891bab8-fdeb-424b-845f-80c2330032d2 could not be found. Aug 03 10:50:52.145922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:50:52.148026 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-14f13e8d-ab4e-487f-9984-68e2200ab446 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] Returning 404 to user: Volume f891bab8-fdeb-424b-845f-80c2330032d2 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:50:52.149083 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-14f13e8d-ab4e-487f-9984-68e2200ab446 tempest-VolumesNegativeTest-1673038425 tempest-VolumesNegativeTest-1673038425-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/f891bab8-fdeb-424b-845f-80c2330032d2" status: 404 len: 109 microversion: 2.1 time: 0.055385 Aug 03 10:50:52.149821 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 464/910] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 3 10:50:52 2022] GET /compute/v2.1/os-volumes/f891bab8-fdeb-424b-845f-80c2330032d2 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:51:04.530756 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:51:04.531883 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=88,nova_cell1:INSERT=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:51:04.538140 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c2dfeba1-45f4-4fd8-98c8-49479e9c97c7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Action: 'create', calling method: .version_select at 0x7fbd1056f0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-716418589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG52bat9PMFAkvI6AUwcW0orR72T4scUX5cQ11Pu0z30kif/fSXdQwQzr7HeFqf3f8ZDzH7p/foS9KmJnV05EZbiSPFhhxphozXMwztCWQ13CcMB6BuuZ7RTS6erameCzg=="}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:51:04.575178 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-c2dfeba1-45f4-4fd8-98c8-49479e9c97c7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Getting quotas for project ac7eca525bbe4443a7b99e0aa921050e. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:51:04.584149 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-c2dfeba1-45f4-4fd8-98c8-49479e9c97c7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Getting quotas for user 538d552b04a8446094d2e84952804795 and project ac7eca525bbe4443a7b99e0aa921050e. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:51:04.634039 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c2dfeba1-45f4-4fd8-98c8-49479e9c97c7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.105088 Aug 03 10:51:04.634659 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 447/911] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 3 10:51:04 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:51:04.791496 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=7 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:51:04.792881 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:51:04.797940 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1907792839", "imageRef": "d8162852-8d24-4809-ac1d-d385e3cee2b0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-716418589", "networks": [{"uuid": "d1072206-0a3a-45f8-af25-a96732447154"}]}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:51:04.897165 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] validate_networks() for [('d1072206-0a3a-45f8-af25-a96732447154', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:51:05.674370 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:51:05.675295 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:51:05.676567 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:51:05.677249 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:51:05.677950 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:51:05.697143 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:05.698120 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:05.699449 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:05.700141 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:05.736046 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Getting quotas for project ac7eca525bbe4443a7b99e0aa921050e. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:51:05.746017 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Getting quotas for user 538d552b04a8446094d2e84952804795 and project ac7eca525bbe4443a7b99e0aa921050e. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:51:05.767552 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:51:05.770880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d8162852-8d24-4809-ac1d-d385e3cee2b0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:51:05.854460 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-20bc1896-8b6c-4a44-a773-5493e2585fc8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.067429 Aug 03 10:51:05.856307 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 465/912] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:51:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:51:05.869875 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-f8f4c317-e23e-42ad-9a0d-f8191ebf0034 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:05.870511 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-f8f4c317-e23e-42ad-9a0d-f8191ebf0034 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:05.950372 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f8f4c317-e23e-42ad-9a0d-f8191ebf0034 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:05.968172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-f8f4c317-e23e-42ad-9a0d-f8191ebf0034 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1258 microversion: 2.1 time: 0.103420 Aug 03 10:51:05.969271 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 448/913] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:05 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1258 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:06.994975 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f8ce1694-ff1a-4597-b290-243ab25fa086 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:06.996019 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f8ce1694-ff1a-4597-b290-243ab25fa086 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:07.004953 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8ce1694-ff1a-4597-b290-243ab25fa086 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:07.005397 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8ce1694-ff1a-4597-b290-243ab25fa086 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:07.006223 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8ce1694-ff1a-4597-b290-243ab25fa086 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:07.006666 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8ce1694-ff1a-4597-b290-243ab25fa086 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:07.284751 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f8ce1694-ff1a-4597-b290-243ab25fa086 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:07.306778 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f8ce1694-ff1a-4597-b290-243ab25fa086 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1310 microversion: 2.1 time: 0.317319 Aug 03 10:51:07.322629 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 466/914] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:06 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1310 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:08.353613 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3b7fa537-5547-4249-aa69-776014dd04ce tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:08.358261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3b7fa537-5547-4249-aa69-776014dd04ce tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:08.396946 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3b7fa537-5547-4249-aa69-776014dd04ce tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:08.398431 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3b7fa537-5547-4249-aa69-776014dd04ce tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:08.403189 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3b7fa537-5547-4249-aa69-776014dd04ce tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:08.406497 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3b7fa537-5547-4249-aa69-776014dd04ce tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:08.943778 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-3b7fa537-5547-4249-aa69-776014dd04ce tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:08.970660 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3b7fa537-5547-4249-aa69-776014dd04ce tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1358 microversion: 2.1 time: 0.627774 Aug 03 10:51:08.971647 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 449/915] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:08 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1358 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:10.014737 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d41b850a-dea4-487c-a71b-af3356d6fa99 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:10.016274 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d41b850a-dea4-487c-a71b-af3356d6fa99 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:10.024559 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d41b850a-dea4-487c-a71b-af3356d6fa99 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:10.025048 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d41b850a-dea4-487c-a71b-af3356d6fa99 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:10.026155 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d41b850a-dea4-487c-a71b-af3356d6fa99 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:10.026597 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d41b850a-dea4-487c-a71b-af3356d6fa99 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:10.369500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-425f593c-950b-42f1-9f9a-9554281f1c94 req-948cd60c-08f3-412b-8f92-39d95b216f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a25924-4ed2-43e0-85ff-bc4b9ad88387", "tag": "9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:51:10.390458 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-425f593c-950b-42f1-9f9a-9554281f1c94 req-948cd60c-08f3-412b-8f92-39d95b216f26 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:10.399080 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-425f593c-950b-42f1-9f9a-9554281f1c94 req-948cd60c-08f3-412b-8f92-39d95b216f26 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:10.424040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-425f593c-950b-42f1-9f9a-9554281f1c94 req-948cd60c-08f3-412b-8f92-39d95b216f26 service nova] Creating event network-changed:9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff for instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 on hv-cinder-85083 Aug 03 10:51:10.435395 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-425f593c-950b-42f1-9f9a-9554281f1c94 req-948cd60c-08f3-412b-8f92-39d95b216f26 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072317 Aug 03 10:51:10.436001 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 450/916] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:51:10.722524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d41b850a-dea4-487c-a71b-af3356d6fa99 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:10.738954 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d41b850a-dea4-487c-a71b-af3356d6fa99 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1358 microversion: 2.1 time: 0.727822 Aug 03 10:51:10.741003 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 467/917] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:10 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1358 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:11.788034 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-7e3aa4f6-a618-4c5a-a51d-19901968ca73 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:11.789394 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-7e3aa4f6-a618-4c5a-a51d-19901968ca73 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:11.814116 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7e3aa4f6-a618-4c5a-a51d-19901968ca73 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:11.815771 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7e3aa4f6-a618-4c5a-a51d-19901968ca73 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:11.817054 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7e3aa4f6-a618-4c5a-a51d-19901968ca73 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:11.817509 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7e3aa4f6-a618-4c5a-a51d-19901968ca73 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:12.055660 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7e3aa4f6-a618-4c5a-a51d-19901968ca73 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:12.068587 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-7e3aa4f6-a618-4c5a-a51d-19901968ca73 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1358 microversion: 2.1 time: 0.293344 Aug 03 10:51:12.070193 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 451/918] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:11 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:51:13.100839 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8b96fe40-b15e-4ac6-a529-9900d17890a5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:13.101441 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8b96fe40-b15e-4ac6-a529-9900d17890a5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:13.110190 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b96fe40-b15e-4ac6-a529-9900d17890a5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:13.110915 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b96fe40-b15e-4ac6-a529-9900d17890a5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:13.112238 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b96fe40-b15e-4ac6-a529-9900d17890a5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:13.112978 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b96fe40-b15e-4ac6-a529-9900d17890a5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:13.257381 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8b96fe40-b15e-4ac6-a529-9900d17890a5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:13.265731 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8b96fe40-b15e-4ac6-a529-9900d17890a5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1358 microversion: 2.1 time: 0.168756 Aug 03 10:51:13.266506 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 468/919] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:13 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:14.288156 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5937c858-e65b-4b90-a04f-12244d11be2f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:14.290286 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-5937c858-e65b-4b90-a04f-12244d11be2f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:14.297672 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5937c858-e65b-4b90-a04f-12244d11be2f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:14.298391 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5937c858-e65b-4b90-a04f-12244d11be2f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:14.299345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5937c858-e65b-4b90-a04f-12244d11be2f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:14.299970 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5937c858-e65b-4b90-a04f-12244d11be2f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:14.509836 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5937c858-e65b-4b90-a04f-12244d11be2f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:14.532299 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5937c858-e65b-4b90-a04f-12244d11be2f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1358 microversion: 2.1 time: 0.249125 Aug 03 10:51:14.533968 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 452/920] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:14 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:15.560346 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3e6f7e81-661e-4b40-989a-2ea753fa5e10 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:15.561716 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3e6f7e81-661e-4b40-989a-2ea753fa5e10 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:15.573830 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3e6f7e81-661e-4b40-989a-2ea753fa5e10 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:15.574607 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3e6f7e81-661e-4b40-989a-2ea753fa5e10 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:15.575804 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3e6f7e81-661e-4b40-989a-2ea753fa5e10 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:15.576445 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3e6f7e81-661e-4b40-989a-2ea753fa5e10 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:15.716833 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:51:15.761313 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=6 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:51:15.767133 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-84bcef0b-2fcd-4f66-9437-ca47f74a1117 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:15.767691 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-84bcef0b-2fcd-4f66-9437-ca47f74a1117 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:15.786664 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-84bcef0b-2fcd-4f66-9437-ca47f74a1117 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:15.787127 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-84bcef0b-2fcd-4f66-9437-ca47f74a1117 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:15.787934 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-84bcef0b-2fcd-4f66-9437-ca47f74a1117 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:15.788373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-84bcef0b-2fcd-4f66-9437-ca47f74a1117 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:15.791163 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3e6f7e81-661e-4b40-989a-2ea753fa5e10 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:15.800357 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3e6f7e81-661e-4b40-989a-2ea753fa5e10 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1358 microversion: 2.1 time: 0.244286 Aug 03 10:51:15.802762 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 469/921] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:15 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:15.820179 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-61f69674-988d-483f-96a6-081e90b81bbd req-03d14c99-55b2-49ce-8377-b596acd9031a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e1399d5-9f28-4b92-a752-a233a1652022", "tag": "ea1ca950-d067-4257-9371-6667208eda63"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:51:15.852709 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-61f69674-988d-483f-96a6-081e90b81bbd req-03d14c99-55b2-49ce-8377-b596acd9031a service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:15.853296 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-61f69674-988d-483f-96a6-081e90b81bbd req-03d14c99-55b2-49ce-8377-b596acd9031a service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:15.866024 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-61f69674-988d-483f-96a6-081e90b81bbd req-03d14c99-55b2-49ce-8377-b596acd9031a service nova] Creating event network-changed:ea1ca950-d067-4257-9371-6667208eda63 for instance 7e1399d5-9f28-4b92-a752-a233a1652022 on hv-cinder-85083 Aug 03 10:51:15.872259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-61f69674-988d-483f-96a6-081e90b81bbd req-03d14c99-55b2-49ce-8377-b596acd9031a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055502 Aug 03 10:51:15.873274 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 470/922] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:51:15.874199 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-84bcef0b-2fcd-4f66-9437-ca47f74a1117 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Going to try to terminate instance {{(pid=124389) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:51:15.975989 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=6 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:51:16.136456 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-84bcef0b-2fcd-4f66-9437-ca47f74a1117 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 204 len: 0 microversion: 2.1 time: 0.373469 Aug 03 10:51:16.137148 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 453/923] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:51:15 2022] DELETE /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:51:16.146753 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a10db631-1154-4fb5-a438-fa1af5f59954 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:16.148010 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a10db631-1154-4fb5-a438-fa1af5f59954 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:16.162746 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a10db631-1154-4fb5-a438-fa1af5f59954 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:16.165457 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a10db631-1154-4fb5-a438-fa1af5f59954 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:16.166469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a10db631-1154-4fb5-a438-fa1af5f59954 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:16.171159 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a10db631-1154-4fb5-a438-fa1af5f59954 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:16.382641 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a10db631-1154-4fb5-a438-fa1af5f59954 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:16.392592 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a10db631-1154-4fb5-a438-fa1af5f59954 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1569 microversion: 2.1 time: 0.250604 Aug 03 10:51:16.394029 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 471/924] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:16 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:16.827289 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-69cf37dd-8ac3-4847-a8cb-0959f764b49f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:16.828065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-69cf37dd-8ac3-4847-a8cb-0959f764b49f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:16.837141 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-69cf37dd-8ac3-4847-a8cb-0959f764b49f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:16.837604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-69cf37dd-8ac3-4847-a8cb-0959f764b49f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:16.844251 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-69cf37dd-8ac3-4847-a8cb-0959f764b49f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:16.844697 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-69cf37dd-8ac3-4847-a8cb-0959f764b49f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:17.051962 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-69cf37dd-8ac3-4847-a8cb-0959f764b49f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:17.060882 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-69cf37dd-8ac3-4847-a8cb-0959f764b49f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1358 microversion: 2.1 time: 0.242436 Aug 03 10:51:17.061782 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 454/925] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:16 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:17.422306 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cc93dda2-0d75-45f5-921a-089140a46888 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:17.425426 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-cc93dda2-0d75-45f5-921a-089140a46888 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:17.447915 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc93dda2-0d75-45f5-921a-089140a46888 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:17.448374 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc93dda2-0d75-45f5-921a-089140a46888 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:17.449168 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc93dda2-0d75-45f5-921a-089140a46888 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:17.449828 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc93dda2-0d75-45f5-921a-089140a46888 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:17.624038 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-cc93dda2-0d75-45f5-921a-089140a46888 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:17.632245 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-cc93dda2-0d75-45f5-921a-089140a46888 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1569 microversion: 2.1 time: 0.220182 Aug 03 10:51:17.632895 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 472/926] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:17 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:18.083475 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2157accc-4d0b-4c65-8bb6-f6d951115da8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:18.084165 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2157accc-4d0b-4c65-8bb6-f6d951115da8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:18.090914 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2157accc-4d0b-4c65-8bb6-f6d951115da8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:18.091364 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2157accc-4d0b-4c65-8bb6-f6d951115da8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:18.092147 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2157accc-4d0b-4c65-8bb6-f6d951115da8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:18.092593 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2157accc-4d0b-4c65-8bb6-f6d951115da8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:18.237374 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2157accc-4d0b-4c65-8bb6-f6d951115da8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:18.246348 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2157accc-4d0b-4c65-8bb6-f6d951115da8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1358 microversion: 2.1 time: 0.167725 Aug 03 10:51:18.246893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 455/927] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:18 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:18.657565 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-03c3fd55-6c7d-416f-b785-bbc63d48bdcf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:18.658809 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-03c3fd55-6c7d-416f-b785-bbc63d48bdcf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:18.667162 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-03c3fd55-6c7d-416f-b785-bbc63d48bdcf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:18.667628 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-03c3fd55-6c7d-416f-b785-bbc63d48bdcf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:18.668448 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-03c3fd55-6c7d-416f-b785-bbc63d48bdcf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:18.669006 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-03c3fd55-6c7d-416f-b785-bbc63d48bdcf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:18.829585 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-03c3fd55-6c7d-416f-b785-bbc63d48bdcf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:18.838390 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-03c3fd55-6c7d-416f-b785-bbc63d48bdcf tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1569 microversion: 2.1 time: 0.187549 Aug 03 10:51:18.838973 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 473/928] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:18 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:51:19.267550 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6012e634-738e-4097-8124-dc0d898972bc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:19.268218 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6012e634-738e-4097-8124-dc0d898972bc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:19.274948 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6012e634-738e-4097-8124-dc0d898972bc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:19.275393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6012e634-738e-4097-8124-dc0d898972bc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:19.276164 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6012e634-738e-4097-8124-dc0d898972bc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:19.276604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6012e634-738e-4097-8124-dc0d898972bc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:19.441298 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-6012e634-738e-4097-8124-dc0d898972bc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:19.448964 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-6012e634-738e-4097-8124-dc0d898972bc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1358 microversion: 2.1 time: 0.185523 Aug 03 10:51:19.449561 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 456/929] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:19 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:19.859939 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-42b7caef-9460-4a30-9900-61e126f4ccfb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:19.860556 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-42b7caef-9460-4a30-9900-61e126f4ccfb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:19.867923 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-42b7caef-9460-4a30-9900-61e126f4ccfb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:19.868372 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-42b7caef-9460-4a30-9900-61e126f4ccfb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:19.869166 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-42b7caef-9460-4a30-9900-61e126f4ccfb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:19.869640 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-42b7caef-9460-4a30-9900-61e126f4ccfb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:20.045585 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-42b7caef-9460-4a30-9900-61e126f4ccfb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:20.068288 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-42b7caef-9460-4a30-9900-61e126f4ccfb tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1569 microversion: 2.1 time: 0.211821 Aug 03 10:51:20.069249 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 474/930] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:19 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:20.475004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-26d53027-806a-4ab5-808c-32f57f2f33bd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:20.476161 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-26d53027-806a-4ab5-808c-32f57f2f33bd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:20.487478 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-26d53027-806a-4ab5-808c-32f57f2f33bd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:20.487926 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-26d53027-806a-4ab5-808c-32f57f2f33bd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:20.488723 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-26d53027-806a-4ab5-808c-32f57f2f33bd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:20.489184 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-26d53027-806a-4ab5-808c-32f57f2f33bd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:20.710595 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-26d53027-806a-4ab5-808c-32f57f2f33bd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:20.722022 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-26d53027-806a-4ab5-808c-32f57f2f33bd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1358 microversion: 2.1 time: 0.254198 Aug 03 10:51:20.722977 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 457/931] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:20 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:21.097927 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a59f41b6-9954-4bc6-948b-a51280d33cce tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:21.098663 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a59f41b6-9954-4bc6-948b-a51280d33cce tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:21.117393 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a59f41b6-9954-4bc6-948b-a51280d33cce tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:21.117967 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a59f41b6-9954-4bc6-948b-a51280d33cce tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:21.118836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a59f41b6-9954-4bc6-948b-a51280d33cce tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:21.119275 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a59f41b6-9954-4bc6-948b-a51280d33cce tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:21.296396 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a59f41b6-9954-4bc6-948b-a51280d33cce tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:21.311728 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a59f41b6-9954-4bc6-948b-a51280d33cce tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1450 microversion: 2.1 time: 0.217459 Aug 03 10:51:21.312839 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 475/932] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:21 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1450 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:21.529533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-b6252a2e-9283-45ca-a561-6d3e9e9f9420 req-002668d9-2a21-446a-bab2-a2d70fb653a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e1399d5-9f28-4b92-a752-a233a1652022", "name": "network-vif-deleted", "tag": "ea1ca950-d067-4257-9371-6667208eda63"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:51:21.543019 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-b6252a2e-9283-45ca-a561-6d3e9e9f9420 req-002668d9-2a21-446a-bab2-a2d70fb653a5 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:21.543456 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-b6252a2e-9283-45ca-a561-6d3e9e9f9420 req-002668d9-2a21-446a-bab2-a2d70fb653a5 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:21.556988 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-b6252a2e-9283-45ca-a561-6d3e9e9f9420 req-002668d9-2a21-446a-bab2-a2d70fb653a5 service nova] Creating event network-vif-deleted:ea1ca950-d067-4257-9371-6667208eda63 for instance 7e1399d5-9f28-4b92-a752-a233a1652022 on hv-cinder-85083 Aug 03 10:51:21.562496 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-b6252a2e-9283-45ca-a561-6d3e9e9f9420 req-002668d9-2a21-446a-bab2-a2d70fb653a5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040208 Aug 03 10:51:21.563148 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 458/933] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:51:21.746720 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8614a135-82fa-4246-8dd6-2f509a9512fc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:21.747420 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8614a135-82fa-4246-8dd6-2f509a9512fc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:21.754829 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8614a135-82fa-4246-8dd6-2f509a9512fc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:21.755463 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8614a135-82fa-4246-8dd6-2f509a9512fc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:21.756345 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8614a135-82fa-4246-8dd6-2f509a9512fc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:21.756871 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8614a135-82fa-4246-8dd6-2f509a9512fc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:21.913113 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8614a135-82fa-4246-8dd6-2f509a9512fc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:21.921632 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8614a135-82fa-4246-8dd6-2f509a9512fc tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1358 microversion: 2.1 time: 0.181331 Aug 03 10:51:21.922498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 476/934] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:21 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:22.348399 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-f1a3d47d-62e3-4ca5-8d55-c54314aa3c1d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:22.349088 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-f1a3d47d-62e3-4ca5-8d55-c54314aa3c1d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:22.355535 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f1a3d47d-62e3-4ca5-8d55-c54314aa3c1d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:22.355980 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f1a3d47d-62e3-4ca5-8d55-c54314aa3c1d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:22.356893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f1a3d47d-62e3-4ca5-8d55-c54314aa3c1d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:22.357712 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f1a3d47d-62e3-4ca5-8d55-c54314aa3c1d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:22.436995 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f1a3d47d-62e3-4ca5-8d55-c54314aa3c1d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb192800160427e9951a759dd10b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2e98a33cba4c08a55cda8dd6ed0730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:22.446053 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-f1a3d47d-62e3-4ca5-8d55-c54314aa3c1d tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 200 len: 1219 microversion: 2.1 time: 0.101528 Aug 03 10:51:22.446708 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 459/935] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:22 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:51:22.853836 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7330b3db-89d2-4630-aae7-deeaa758ee1f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:22.856151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7330b3db-89d2-4630-aae7-deeaa758ee1f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:22.864496 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7330b3db-89d2-4630-aae7-deeaa758ee1f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:22.864944 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7330b3db-89d2-4630-aae7-deeaa758ee1f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:22.866044 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7330b3db-89d2-4630-aae7-deeaa758ee1f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:22.866498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7330b3db-89d2-4630-aae7-deeaa758ee1f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:22.913138 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7330b3db-89d2-4630-aae7-deeaa758ee1f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.063635 Aug 03 10:51:22.915530 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 477/936] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 3 10:51:22 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:22.956037 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a1ec0b27-9afe-4394-bf67-7be619a45207 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:22.959647 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-a1ec0b27-9afe-4394-bf67-7be619a45207 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:22.973123 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a1ec0b27-9afe-4394-bf67-7be619a45207 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:22.973980 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a1ec0b27-9afe-4394-bf67-7be619a45207 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:22.975285 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a1ec0b27-9afe-4394-bf67-7be619a45207 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:22.975997 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a1ec0b27-9afe-4394-bf67-7be619a45207 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:23.030144 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0eb7f179-10b9-4052-8b79-d543361c086d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:23.030814 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0eb7f179-10b9-4052-8b79-d543361c086d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:23.037292 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0eb7f179-10b9-4052-8b79-d543361c086d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:23.038703 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0eb7f179-10b9-4052-8b79-d543361c086d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:23.040140 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0eb7f179-10b9-4052-8b79-d543361c086d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:23.040618 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0eb7f179-10b9-4052-8b79-d543361c086d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:23.067918 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0eb7f179-10b9-4052-8b79-d543361c086d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:51:23.164764 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-a1ec0b27-9afe-4394-bf67-7be619a45207 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:23.175526 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-a1ec0b27-9afe-4394-bf67-7be619a45207 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1358 microversion: 2.1 time: 0.231851 Aug 03 10:51:23.177282 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 460/937] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:22 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:23.198646 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0eb7f179-10b9-4052-8b79-d543361c086d tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "DELETE /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 204 len: 0 microversion: 2.20 time: 0.174442 Aug 03 10:51:23.199589 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 478/938] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Aug 3 10:51:23 2022] DELETE /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 10:51:23.208566 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9b714ad2-3837-46db-b626-6dbe783ff930 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:23.209180 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9b714ad2-3837-46db-b626-6dbe783ff930 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:23.216499 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b714ad2-3837-46db-b626-6dbe783ff930 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:23.216951 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b714ad2-3837-46db-b626-6dbe783ff930 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:23.217772 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b714ad2-3837-46db-b626-6dbe783ff930 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:23.218209 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b714ad2-3837-46db-b626-6dbe783ff930 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:23.394446 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9b714ad2-3837-46db-b626-6dbe783ff930 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:23.404736 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9b714ad2-3837-46db-b626-6dbe783ff930 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:23.406432 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9b714ad2-3837-46db-b626-6dbe783ff930 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:23.407827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9b714ad2-3837-46db-b626-6dbe783ff930 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1722 microversion: 2.20 time: 0.203436 Aug 03 10:51:23.408490 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 461/939] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:51:23 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 10:51:23.467814 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-31551267-0a21-4945-9a80-16cefcfd9b09 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:23.468520 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-31551267-0a21-4945-9a80-16cefcfd9b09 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] [instance: 7e1399d5-9f28-4b92-a752-a233a1652022] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:23.475703 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-31551267-0a21-4945-9a80-16cefcfd9b09 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:23.476204 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-31551267-0a21-4945-9a80-16cefcfd9b09 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:23.476998 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-31551267-0a21-4945-9a80-16cefcfd9b09 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:23.477433 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-31551267-0a21-4945-9a80-16cefcfd9b09 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:23.495825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-31551267-0a21-4945-9a80-16cefcfd9b09 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] HTTP exception thrown: Instance 7e1399d5-9f28-4b92-a752-a233a1652022 could not be found. Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-31551267-0a21-4945-9a80-16cefcfd9b09 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Request method failure captured: Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 HTTP/1.1 Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lHHFqeTm6-Xcz-9iKNFU3LUQmpltQVnpUvl47YuyEBZjtxrtzyGe4TkCVsp4vn98xX-N-mJqFliWrVOIYjotOjReBDb7R2V9gFx73YVeMV1YUF7sCJY9ybijHyYseC4i9oE7T6h2jbeTpfA3ILQslB64fejlSmAgksUPvTJi8-9CwI Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 8c2e98a33cba4c08a55cda8dd6ed0730 Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-TestShelveInstance-13282668 Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:51:23.497734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:51:23.500335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8c2e98a33cba4c08a55cda8dd6ed0730"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8c2e98a33cba4c08a55cda8dd6ed0730"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8c2e98a33cba4c08a55cda8dd6ed0730"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8c2e98a33cba4c08a55cda8dd6ed0730", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:51:23.500335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-TestShelveInstance-13282668 Aug 03 10:51:23.500335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 8c2e98a33cba4c08a55cda8dd6ed0730 Aug 03 10:51:23.500335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-TestShelveInstance-13282668 Aug 03 10:51:23.500335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-TestShelveInstance-13282668-project Aug 03 10:51:23.500335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:51:23.500335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:51:23.500335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 7cb192800160427e9951a759dd10b228 Aug 03 10:51:23.500335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-TestShelveInstance-13282668-project Aug 03 10:51:23.500335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:51:23.500335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance 7e1399d5-9f28-4b92-a752-a233a1652022 could not be found. Aug 03 10:51:23.500335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': '7e1399d5-9f28-4b92-a752-a233a1652022'} Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e1399d5-9f28-4b92-a752-a233a1652022 could not be found. Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:51:23.502174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e1399d5-9f28-4b92-a752-a233a1652022 could not be found. Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e1399d5-9f28-4b92-a752-a233a1652022 could not be found. Aug 03 10:51:23.504491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:23.506696 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-31551267-0a21-4945-9a80-16cefcfd9b09 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Returning 404 to user: Instance 7e1399d5-9f28-4b92-a752-a233a1652022 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:51:23.506696 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-31551267-0a21-4945-9a80-16cefcfd9b09 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022" status: 404 len: 111 microversion: 2.1 time: 0.035954 Aug 03 10:51:23.506696 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 479/940] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:23 2022] GET /compute/v2.1/servers/7e1399d5-9f28-4b92-a752-a233a1652022 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:51:23.708526 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c19e0080-b8fa-4cb5-b3b8-b6d51deb4815 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] Calling method '.version_select at 0x7fbd10520dc0>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:23.736560 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c19e0080-b8fa-4cb5-b3b8-b6d51deb4815 tempest-TestShelveInstance-13282668 tempest-TestShelveInstance-13282668-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-241344085" status: 202 len: 0 microversion: 2.1 time: 0.035198 Aug 03 10:51:23.737425 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 462/941] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 3 10:51:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-241344085 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:51:24.200008 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b2dcfbd8-f56f-495d-9522-fa8da1b79cbf tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:24.201169 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b2dcfbd8-f56f-495d-9522-fa8da1b79cbf tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:24.210603 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b2dcfbd8-f56f-495d-9522-fa8da1b79cbf tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:24.211678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b2dcfbd8-f56f-495d-9522-fa8da1b79cbf tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:24.213188 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b2dcfbd8-f56f-495d-9522-fa8da1b79cbf tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:24.218508 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b2dcfbd8-f56f-495d-9522-fa8da1b79cbf tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:24.436143 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-94de108b-87a1-4532-b5c4-7d8c22b425de tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:24.437004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-94de108b-87a1-4532-b5c4-7d8c22b425de tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:24.454242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-94de108b-87a1-4532-b5c4-7d8c22b425de tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:24.455211 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-94de108b-87a1-4532-b5c4-7d8c22b425de tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:24.458657 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-94de108b-87a1-4532-b5c4-7d8c22b425de tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:24.459180 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-94de108b-87a1-4532-b5c4-7d8c22b425de tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:24.484871 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b2dcfbd8-f56f-495d-9522-fa8da1b79cbf tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:24.498186 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b2dcfbd8-f56f-495d-9522-fa8da1b79cbf tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1358 microversion: 2.1 time: 0.302548 Aug 03 10:51:24.507044 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 480/942] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:24 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:24.800907 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-94de108b-87a1-4532-b5c4-7d8c22b425de tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:24.814747 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-94de108b-87a1-4532-b5c4-7d8c22b425de tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:24.817670 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-94de108b-87a1-4532-b5c4-7d8c22b425de tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:24.820865 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-94de108b-87a1-4532-b5c4-7d8c22b425de tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1722 microversion: 2.20 time: 0.391890 Aug 03 10:51:24.821819 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 463/943] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:51:24 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1722 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:51:25.533261 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a77ec42c-9f13-422b-ac17-4e86d42a2758 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:25.534487 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a77ec42c-9f13-422b-ac17-4e86d42a2758 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:25.556107 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a77ec42c-9f13-422b-ac17-4e86d42a2758 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:25.557078 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a77ec42c-9f13-422b-ac17-4e86d42a2758 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:25.558306 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a77ec42c-9f13-422b-ac17-4e86d42a2758 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:25.559355 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a77ec42c-9f13-422b-ac17-4e86d42a2758 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:25.849525 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a77ec42c-9f13-422b-ac17-4e86d42a2758 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:25.867769 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-594bcef9-90e9-4153-b800-f949a7006ad1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:25.875161 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:51:25.876037 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-594bcef9-90e9-4153-b800-f949a7006ad1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:25.897512 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-594bcef9-90e9-4153-b800-f949a7006ad1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:25.902892 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a77ec42c-9f13-422b-ac17-4e86d42a2758 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1358 microversion: 2.1 time: 0.375299 Aug 03 10:51:25.904404 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 481/944] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:25 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1358 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:25.905780 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-594bcef9-90e9-4153-b800-f949a7006ad1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:25.908356 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-594bcef9-90e9-4153-b800-f949a7006ad1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:25.909646 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-594bcef9-90e9-4153-b800-f949a7006ad1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:26.075315 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-594bcef9-90e9-4153-b800-f949a7006ad1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:26.100957 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-594bcef9-90e9-4153-b800-f949a7006ad1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:26.109732 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-594bcef9-90e9-4153-b800-f949a7006ad1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:26.112992 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-594bcef9-90e9-4153-b800-f949a7006ad1 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1656 microversion: 2.20 time: 0.260133 Aug 03 10:51:26.113634 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 464/945] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:51:25 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1656 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:51:26.285804 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-01b4b251-667e-4772-a466-31eb9805795c req-373629c8-58a4-4e6b-a3c7-21522117c77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a25924-4ed2-43e0-85ff-bc4b9ad88387", "name": "network-vif-plugged", "status": "completed", "tag": "9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:51:26.316424 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-01b4b251-667e-4772-a466-31eb9805795c req-373629c8-58a4-4e6b-a3c7-21522117c77b service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:26.317100 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-01b4b251-667e-4772-a466-31eb9805795c req-373629c8-58a4-4e6b-a3c7-21522117c77b service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:26.340681 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-01b4b251-667e-4772-a466-31eb9805795c req-373629c8-58a4-4e6b-a3c7-21522117c77b service nova] Creating event network-vif-plugged:9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff for instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 on hv-cinder-85083 Aug 03 10:51:26.348232 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-01b4b251-667e-4772-a466-31eb9805795c req-373629c8-58a4-4e6b-a3c7-21522117c77b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064757 Aug 03 10:51:26.349833 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 482/946] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:51:26.690204 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-30c5bc69-72b2-48c2-bde8-5115f9df0bd7 req-776b2094-2b88-412e-a85d-e85449436fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cbe8d4-0681-4b94-a774-1f0067f69263", "name": "network-vif-deleted", "tag": "5c7bb60f-6fc3-4d3d-bda1-d77d9a5e91fb"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:51:26.772828 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-30c5bc69-72b2-48c2-bde8-5115f9df0bd7 req-776b2094-2b88-412e-a85d-e85449436fa2 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:26.782624 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-30c5bc69-72b2-48c2-bde8-5115f9df0bd7 req-776b2094-2b88-412e-a85d-e85449436fa2 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:26.894756 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-30c5bc69-72b2-48c2-bde8-5115f9df0bd7 req-776b2094-2b88-412e-a85d-e85449436fa2 service nova] Creating event network-vif-deleted:5c7bb60f-6fc3-4d3d-bda1-d77d9a5e91fb for instance 99cbe8d4-0681-4b94-a774-1f0067f69263 on hv-cinder-85083 Aug 03 10:51:26.918255 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-30c5bc69-72b2-48c2-bde8-5115f9df0bd7 req-776b2094-2b88-412e-a85d-e85449436fa2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246739 Aug 03 10:51:26.930864 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1fab47dd-7d4b-4ba1-ac46-4fca3af9d73d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:26.931530 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 465/947] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:51:26.931735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1fab47dd-7d4b-4ba1-ac46-4fca3af9d73d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:26.971962 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1fab47dd-7d4b-4ba1-ac46-4fca3af9d73d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:26.981341 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1fab47dd-7d4b-4ba1-ac46-4fca3af9d73d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:26.986728 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1fab47dd-7d4b-4ba1-ac46-4fca3af9d73d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:27.000364 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1fab47dd-7d4b-4ba1-ac46-4fca3af9d73d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:27.168630 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d8d0c0c2-d9c6-4a7c-8698-5b847edcdff7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:27.169888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d8d0c0c2-d9c6-4a7c-8698-5b847edcdff7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:27.198290 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d8d0c0c2-d9c6-4a7c-8698-5b847edcdff7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:27.199231 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d8d0c0c2-d9c6-4a7c-8698-5b847edcdff7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:27.200606 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d8d0c0c2-d9c6-4a7c-8698-5b847edcdff7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:27.201325 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d8d0c0c2-d9c6-4a7c-8698-5b847edcdff7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:27.288772 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d8d0c0c2-d9c6-4a7c-8698-5b847edcdff7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:27.289760 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d8d0c0c2-d9c6-4a7c-8698-5b847edcdff7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:27.290797 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-d8d0c0c2-d9c6-4a7c-8698-5b847edcdff7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lazy-loading 'fault' on Instance uuid 99cbe8d4-0681-4b94-a774-1f0067f69263 {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:51:27.315306 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:51:27.511789 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d8d0c0c2-d9c6-4a7c-8698-5b847edcdff7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:27.526705 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d8d0c0c2-d9c6-4a7c-8698-5b847edcdff7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:27.528490 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d8d0c0c2-d9c6-4a7c-8698-5b847edcdff7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5744cccc5a224263b71c052dc783e103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157914bad58e4c50b92dfca14ec638aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:27.535755 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d8d0c0c2-d9c6-4a7c-8698-5b847edcdff7 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 200 len: 1371 microversion: 2.20 time: 0.371280 Aug 03 10:51:27.553266 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 466/948] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:51:27 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 1371 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:51:27.722572 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1fab47dd-7d4b-4ba1-ac46-4fca3af9d73d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:27.744844 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1fab47dd-7d4b-4ba1-ac46-4fca3af9d73d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1358 microversion: 2.1 time: 0.820058 Aug 03 10:51:27.745436 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 483/949] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:26 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1358 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:51:28.560885 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3616a971-955e-4c4b-b01d-4cef14c5e13f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:28.561631 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-3616a971-955e-4c4b-b01d-4cef14c5e13f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:28.578627 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3616a971-955e-4c4b-b01d-4cef14c5e13f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:28.579089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3616a971-955e-4c4b-b01d-4cef14c5e13f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:28.582746 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3616a971-955e-4c4b-b01d-4cef14c5e13f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:28.583323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-3616a971-955e-4c4b-b01d-4cef14c5e13f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:28.604990 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-3616a971-955e-4c4b-b01d-4cef14c5e13f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] HTTP exception thrown: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3616a971-955e-4c4b-b01d-4cef14c5e13f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Request method failure captured: Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 HTTP/1.1 Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lFzbglN1fuK7wx7Z7S3zajNqF7NRslPkJH8P0Ggdz6lHWyTNAsu5ZzCjpssV0Is8iK8ZmQZPOm6yPv-6evm-QsLm35VxxulVrOxmdadnMkVyMKyOTg1xl5gA0YJxIK0mUmrlAOR0oFouEqWdaogNB-BG5zkiF9q6q4_S8EIn2dCg1I Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: 157914bad58e4c50b92dfca14ec638aa Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:51:28.606722 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:51:28.608574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_157914bad58e4c50b92dfca14ec638aa", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:51:28.608574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:51:28.608574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: 157914bad58e4c50b92dfca14ec638aa Aug 03 10:51:28.608574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:51:28.608574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-AttachVolumeShelveTestJSON-2033645781-project Aug 03 10:51:28.608574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:51:28.608574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:51:28.608574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 5744cccc5a224263b71c052dc783e103 Aug 03 10:51:28.608574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2033645781-project Aug 03 10:51:28.608574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:51:28.608574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. Aug 03 10:51:28.608574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '99cbe8d4-0681-4b94-a774-1f0067f69263'} Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:51:28.609533 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. Aug 03 10:51:28.611287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:51:28.614736 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-3616a971-955e-4c4b-b01d-4cef14c5e13f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Returning 404 to user: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:51:28.616441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-3616a971-955e-4c4b-b01d-4cef14c5e13f tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 404 len: 111 microversion: 2.20 time: 0.059977 Aug 03 10:51:28.617026 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 467/950] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:51:28 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 03 10:51:28.627117 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1d94a6bc-4c7c-43f8-9a1b-9a7bfb6190f3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '.version_select at 0x7fbd105a6af0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:28.655966 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1d94a6bc-4c7c-43f8-9a1b-9a7bfb6190f3 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-877194784" status: 204 len: 0 microversion: 2.20 time: 0.033210 Aug 03 10:51:28.657891 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 484/951] 10.222.0.47 () {60 vars in 1259 bytes} [Wed Aug 3 10:51:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-877194784 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 03 10:51:28.772690 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2bf1ed3d-a217-418c-949b-f9a41474f560 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:28.776063 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2bf1ed3d-a217-418c-949b-f9a41474f560 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:28.788040 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2bf1ed3d-a217-418c-949b-f9a41474f560 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:28.790684 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2bf1ed3d-a217-418c-949b-f9a41474f560 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:28.791795 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2bf1ed3d-a217-418c-949b-f9a41474f560 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:28.793646 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2bf1ed3d-a217-418c-949b-f9a41474f560 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:29.074283 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2bf1ed3d-a217-418c-949b-f9a41474f560 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:29.083144 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2bf1ed3d-a217-418c-949b-f9a41474f560 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1548 microversion: 2.1 time: 0.318501 Aug 03 10:51:29.084165 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 468/952] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:28 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1548 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:51:29.123151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-57b108ce-dbc4-46ba-b55f-2796963bdd69 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:29.123783 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-57b108ce-dbc4-46ba-b55f-2796963bdd69 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:29.130697 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57b108ce-dbc4-46ba-b55f-2796963bdd69 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:29.131139 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57b108ce-dbc4-46ba-b55f-2796963bdd69 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:29.132131 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57b108ce-dbc4-46ba-b55f-2796963bdd69 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:29.133328 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57b108ce-dbc4-46ba-b55f-2796963bdd69 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:29.482476 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-57b108ce-dbc4-46ba-b55f-2796963bdd69 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:29.496830 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-57b108ce-dbc4-46ba-b55f-2796963bdd69 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1548 microversion: 2.1 time: 0.377417 Aug 03 10:51:29.499402 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 485/953] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:29 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1548 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:51:29.537658 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1d6145b4-5a60-48d8-8706-b6f29a9d1cdb tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:29.552442 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1d6145b4-5a60-48d8-8706-b6f29a9d1cdb tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:29.557255 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-1d6145b4-5a60-48d8-8706-b6f29a9d1cdb tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Searching by: {'deleted': False, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e'} {{(pid=124389) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 10:51:29.594284 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1d6145b4-5a60-48d8-8706-b6f29a9d1cdb tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:29.594892 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1d6145b4-5a60-48d8-8706-b6f29a9d1cdb tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:29.600323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1d6145b4-5a60-48d8-8706-b6f29a9d1cdb tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:29.600760 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1d6145b4-5a60-48d8-8706-b6f29a9d1cdb tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:29.790551 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.multi_cell_list [None req-1d6145b4-5a60-48d8-8706-b6f29a9d1cdb tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124389) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 10:51:29.957673 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1d6145b4-5a60-48d8-8706-b6f29a9d1cdb tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.434088 Aug 03 10:51:29.958727 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 469/954] 10.222.0.47 () {58 vars in 1125 bytes} [Wed Aug 3 10:51:29 2022] GET /compute/v2.1/servers => generated 343 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:51:29.975708 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9947a0e2-4ec8-4976-881f-a1da521a50c0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:29.977606 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9947a0e2-4ec8-4976-881f-a1da521a50c0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:29.988065 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9947a0e2-4ec8-4976-881f-a1da521a50c0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:29.988793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9947a0e2-4ec8-4976-881f-a1da521a50c0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:29.990174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9947a0e2-4ec8-4976-881f-a1da521a50c0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:29.991657 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9947a0e2-4ec8-4976-881f-a1da521a50c0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:30.264011 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9947a0e2-4ec8-4976-881f-a1da521a50c0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:30.279827 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9947a0e2-4ec8-4976-881f-a1da521a50c0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1548 microversion: 2.1 time: 0.309805 Aug 03 10:51:30.280911 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 486/955] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:29 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1548 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:31.091049 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6265d58b-e104-46a2-b3fd-ba5786a08789 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:31.092757 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6265d58b-e104-46a2-b3fd-ba5786a08789 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:31.102724 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6265d58b-e104-46a2-b3fd-ba5786a08789 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:31.103490 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6265d58b-e104-46a2-b3fd-ba5786a08789 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:31.104936 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6265d58b-e104-46a2-b3fd-ba5786a08789 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:31.105981 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6265d58b-e104-46a2-b3fd-ba5786a08789 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:31.127530 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-6265d58b-e104-46a2-b3fd-ba5786a08789 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] HTTP exception thrown: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6265d58b-e104-46a2-b3fd-ba5786a08789 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Request method failure captured: Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: DELETE /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 HTTP/1.1 Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lFzbglN1fuK7wx7Z7S3zajNqF7NRslPkJH8P0Ggdz6lHWyTNAsu5ZzCjpssV0Is8iK8ZmQZPOm6yPv-6evm-QsLm35VxxulVrOxmdadnMkVyMKyOTg1xl5gA0YJxIK0mUmrlAOR0oFouEqWdaogNB-BG5zkiF9q6q4_S8EIn2dCg1I Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: 157914bad58e4c50b92dfca14ec638aa Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:51:31.129248 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:51:31.130827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_157914bad58e4c50b92dfca14ec638aa", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:51:31.130827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:51:31.130827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: 157914bad58e4c50b92dfca14ec638aa Aug 03 10:51:31.130827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:51:31.130827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-AttachVolumeShelveTestJSON-2033645781-project Aug 03 10:51:31.130827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:51:31.130827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:51:31.130827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 5744cccc5a224263b71c052dc783e103 Aug 03 10:51:31.130827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2033645781-project Aug 03 10:51:31.130827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:51:31.130827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. Aug 03 10:51:31.130827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '99cbe8d4-0681-4b94-a774-1f0067f69263'} Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:51:31.131614 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. Aug 03 10:51:31.133479 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:51:31.134767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6265d58b-e104-46a2-b3fd-ba5786a08789 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Returning 404 to user: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:51:31.134767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-6265d58b-e104-46a2-b3fd-ba5786a08789 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "DELETE /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 404 len: 111 microversion: 2.20 time: 0.046665 Aug 03 10:51:31.134767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 470/956] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Aug 3 10:51:31 2022] DELETE /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 10:51:31.146005 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3b880e5b-8f99-41e9-a4ce-fe9d1368d8c0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:31.147175 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3b880e5b-8f99-41e9-a4ce-fe9d1368d8c0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 99cbe8d4-0681-4b94-a774-1f0067f69263] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:31.159857 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b880e5b-8f99-41e9-a4ce-fe9d1368d8c0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:31.160847 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b880e5b-8f99-41e9-a4ce-fe9d1368d8c0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:31.162605 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b880e5b-8f99-41e9-a4ce-fe9d1368d8c0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:31.163506 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b880e5b-8f99-41e9-a4ce-fe9d1368d8c0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:31.193173 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-3b880e5b-8f99-41e9-a4ce-fe9d1368d8c0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] HTTP exception thrown: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3b880e5b-8f99-41e9-a4ce-fe9d1368d8c0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Request method failure captured: Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 HTTP/1.1 Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFzbglN1fuK7wx7Z7S3zajNqF7NRslPkJH8P0Ggdz6lHWyTNAsu5ZzCjpssV0Is8iK8ZmQZPOm6yPv-6evm-QsLm35VxxulVrOxmdadnMkVyMKyOTg1xl5gA0YJxIK0mUmrlAOR0oFouEqWdaogNB-BG5zkiF9q6q4_S8EIn2dCg1I Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 157914bad58e4c50b92dfca14ec638aa Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:51:31.196815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:51:31.198491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_157914bad58e4c50b92dfca14ec638aa", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:51:31.198491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:51:31.198491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 157914bad58e4c50b92dfca14ec638aa Aug 03 10:51:31.198491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:51:31.198491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeShelveTestJSON-2033645781-project Aug 03 10:51:31.198491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:51:31.198491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:51:31.198491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 5744cccc5a224263b71c052dc783e103 Aug 03 10:51:31.198491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2033645781-project Aug 03 10:51:31.198491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:51:31.198491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. Aug 03 10:51:31.198491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': '99cbe8d4-0681-4b94-a774-1f0067f69263'} Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:51:31.199682 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. Aug 03 10:51:31.202519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:31.204840 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3b880e5b-8f99-41e9-a4ce-fe9d1368d8c0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Returning 404 to user: Instance 99cbe8d4-0681-4b94-a774-1f0067f69263 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:51:31.204840 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3b880e5b-8f99-41e9-a4ce-fe9d1368d8c0 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263" status: 404 len: 111 microversion: 2.20 time: 0.062226 Aug 03 10:51:31.204840 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 487/957] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:51:31 2022] GET /compute/v2.1/servers/99cbe8d4-0681-4b94-a774-1f0067f69263 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 10:51:32.261975 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e2c274f0-f11b-4188-8b3b-68aa8f0d9477 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b597270-e3a1-47f8-b003-bc7eaa3d4e3c"}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:51:32.265151 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e2c274f0-f11b-4188-8b3b-68aa8f0d9477 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:32.272642 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e2c274f0-f11b-4188-8b3b-68aa8f0d9477 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:32.273411 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e2c274f0-f11b-4188-8b3b-68aa8f0d9477 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:32.274465 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e2c274f0-f11b-4188-8b3b-68aa8f0d9477 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:32.275083 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e2c274f0-f11b-4188-8b3b-68aa8f0d9477 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:32.467133 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-41cd45d0-8249-4064-bf8d-263554d7d178 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:32.469544 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-41cd45d0-8249-4064-bf8d-263554d7d178 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:32.483439 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41cd45d0-8249-4064-bf8d-263554d7d178 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:32.484673 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41cd45d0-8249-4064-bf8d-263554d7d178 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:32.485791 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41cd45d0-8249-4064-bf8d-263554d7d178 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:32.486678 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41cd45d0-8249-4064-bf8d-263554d7d178 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:32.518471 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-41cd45d0-8249-4064-bf8d-263554d7d178 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] HTTP exception thrown: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-41cd45d0-8249-4064-bf8d-263554d7d178 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Request method failure captured: Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: DELETE /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 HTTP/1.1 Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFzbglN1fuK7wx7Z7S3zajNqF7NRslPkJH8P0Ggdz6lHWyTNAsu5ZzCjpssV0Is8iK8ZmQZPOm6yPv-6evm-QsLm35VxxulVrOxmdadnMkVyMKyOTg1xl5gA0YJxIK0mUmrlAOR0oFouEqWdaogNB-BG5zkiF9q6q4_S8EIn2dCg1I Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 157914bad58e4c50b92dfca14ec638aa Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:51:32.522126 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:51:32.525453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_157914bad58e4c50b92dfca14ec638aa", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:51:32.525453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:51:32.525453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 157914bad58e4c50b92dfca14ec638aa Aug 03 10:51:32.525453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:51:32.525453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeShelveTestJSON-2033645781-project Aug 03 10:51:32.525453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:51:32.525453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:51:32.525453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 5744cccc5a224263b71c052dc783e103 Aug 03 10:51:32.525453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2033645781-project Aug 03 10:51:32.525453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:51:32.525453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. Aug 03 10:51:32.525453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': '5895a291-434d-4b7c-85cd-0264cf37f5f3'} Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:51:32.528803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. Aug 03 10:51:32.535620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:32.541988 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-41cd45d0-8249-4064-bf8d-263554d7d178 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Returning 404 to user: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:51:32.541988 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-41cd45d0-8249-4064-bf8d-263554d7d178 tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 404 len: 111 microversion: 2.20 time: 0.065739 Aug 03 10:51:32.541988 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 488/958] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Aug 3 10:51:32 2022] DELETE /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 10:51:32.549310 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fa4f1fb4-9bc0-4ad6-85d9-21842ddc758b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:32.549997 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fa4f1fb4-9bc0-4ad6-85d9-21842ddc758b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] [instance: 5895a291-434d-4b7c-85cd-0264cf37f5f3] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:32.557314 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fa4f1fb4-9bc0-4ad6-85d9-21842ddc758b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:32.559063 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fa4f1fb4-9bc0-4ad6-85d9-21842ddc758b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:32.560461 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fa4f1fb4-9bc0-4ad6-85d9-21842ddc758b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:32.560916 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fa4f1fb4-9bc0-4ad6-85d9-21842ddc758b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:32.580377 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-fa4f1fb4-9bc0-4ad6-85d9-21842ddc758b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] HTTP exception thrown: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fa4f1fb4-9bc0-4ad6-85d9-21842ddc758b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Request method failure captured: Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 HTTP/1.1 Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lFzbglN1fuK7wx7Z7S3zajNqF7NRslPkJH8P0Ggdz6lHWyTNAsu5ZzCjpssV0Is8iK8ZmQZPOm6yPv-6evm-QsLm35VxxulVrOxmdadnMkVyMKyOTg1xl5gA0YJxIK0mUmrlAOR0oFouEqWdaogNB-BG5zkiF9q6q4_S8EIn2dCg1I Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: 157914bad58e4c50b92dfca14ec638aa Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:51:32.582108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:51:32.586680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157914bad58e4c50b92dfca14ec638aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_157914bad58e4c50b92dfca14ec638aa", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:51:32.586680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:51:32.586680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 157914bad58e4c50b92dfca14ec638aa Aug 03 10:51:32.586680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2033645781 Aug 03 10:51:32.586680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeShelveTestJSON-2033645781-project Aug 03 10:51:32.586680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:51:32.586680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:51:32.586680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 5744cccc5a224263b71c052dc783e103 Aug 03 10:51:32.586680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2033645781-project Aug 03 10:51:32.586680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:51:32.586680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. Aug 03 10:51:32.586680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': '5895a291-434d-4b7c-85cd-0264cf37f5f3'} Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:51:32.589538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. Aug 03 10:51:32.594792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:51:32.608026 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fa4f1fb4-9bc0-4ad6-85d9-21842ddc758b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] Returning 404 to user: Instance 5895a291-434d-4b7c-85cd-0264cf37f5f3 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:51:32.608026 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fa4f1fb4-9bc0-4ad6-85d9-21842ddc758b tempest-AttachVolumeShelveTestJSON-2033645781 tempest-AttachVolumeShelveTestJSON-2033645781-project] 10.222.0.47 "GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3" status: 404 len: 111 microversion: 2.20 time: 0.038734 Aug 03 10:51:32.608026 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 489/959] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 3 10:51:32 2022] GET /compute/v2.1/servers/5895a291-434d-4b7c-85cd-0264cf37f5f3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 03 10:51:32.687709 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e2c274f0-f11b-4188-8b3b-68aa8f0d9477 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "POST /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.429855 Aug 03 10:51:32.688317 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 471/960] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 3 10:51:32 2022] POST /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:51:39.570805 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-800a90a9-a622-4d00-a12a-411bda2cecd0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:39.572145 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-800a90a9-a622-4d00-a12a-411bda2cecd0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:39.579803 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:51:39.591139 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-800a90a9-a622-4d00-a12a-411bda2cecd0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:39.591684 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-800a90a9-a622-4d00-a12a-411bda2cecd0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:39.594105 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-800a90a9-a622-4d00-a12a-411bda2cecd0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:39.595422 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-800a90a9-a622-4d00-a12a-411bda2cecd0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:39.804039 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-800a90a9-a622-4d00-a12a-411bda2cecd0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:39.813288 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-800a90a9-a622-4d00-a12a-411bda2cecd0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1594 microversion: 2.1 time: 0.253136 Aug 03 10:51:39.813952 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 490/961] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:39 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1594 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:51:42.573049 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:51:42.575873 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:51:42.671070 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:51:42.915407 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-fdbb54db-7c97-4b85-a5cc-8cd84953df91 req-20b2992e-99a9-4753-9921-f033cf05655f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a25924-4ed2-43e0-85ff-bc4b9ad88387", "tag": "9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:51:42.933767 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-fdbb54db-7c97-4b85-a5cc-8cd84953df91 req-20b2992e-99a9-4753-9921-f033cf05655f service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:42.934525 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-fdbb54db-7c97-4b85-a5cc-8cd84953df91 req-20b2992e-99a9-4753-9921-f033cf05655f service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:42.985503 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-fdbb54db-7c97-4b85-a5cc-8cd84953df91 req-20b2992e-99a9-4753-9921-f033cf05655f service nova] Creating event network-changed:9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff for instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 on hv-cinder-85083 Aug 03 10:51:43.004321 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-fdbb54db-7c97-4b85-a5cc-8cd84953df91 req-20b2992e-99a9-4753-9921-f033cf05655f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.448627 Aug 03 10:51:43.009324 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 472/962] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:51:44.215357 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-27488b88-a947-45cb-8763-36bf82f783af tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2142719830"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:51:44.217655 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-27488b88-a947-45cb-8763-36bf82f783af tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:44.230017 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-27488b88-a947-45cb-8763-36bf82f783af tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:44.230931 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-27488b88-a947-45cb-8763-36bf82f783af tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:44.232848 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-27488b88-a947-45cb-8763-36bf82f783af tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:44.233687 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-27488b88-a947-45cb-8763-36bf82f783af tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:44.430239 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.network.security_group_api [None req-27488b88-a947-45cb-8763-36bf82f783af tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Adding security group 74cefa62-05ee-41ca-bd54-d2973076256c to port 9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff Aug 03 10:51:44.896695 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-27488b88-a947-45cb-8763-36bf82f783af tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "POST /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/action" status: 202 len: 0 microversion: 2.1 time: 0.690578 Aug 03 10:51:44.897910 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 491/963] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 3 10:51:44 2022] POST /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/action => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:51:44.910740 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-965b2179-fb90-4676-b4b9-c5f6b8371c12 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:51:44.911438 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-965b2179-fb90-4676-b4b9-c5f6b8371c12 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:51:44.918459 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-965b2179-fb90-4676-b4b9-c5f6b8371c12 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:44.918928 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-965b2179-fb90-4676-b4b9-c5f6b8371c12 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:44.919723 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-965b2179-fb90-4676-b4b9-c5f6b8371c12 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:44.920429 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-965b2179-fb90-4676-b4b9-c5f6b8371c12 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:45.052620 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-7b98181e-b3f5-4a5e-9ee5-1f104e7194ce req-d087b31b-9ddf-4afc-b68b-7a7528d948a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a25924-4ed2-43e0-85ff-bc4b9ad88387", "tag": "9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:51:45.064194 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-7b98181e-b3f5-4a5e-9ee5-1f104e7194ce req-d087b31b-9ddf-4afc-b68b-7a7528d948a9 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:51:45.064526 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-7b98181e-b3f5-4a5e-9ee5-1f104e7194ce req-d087b31b-9ddf-4afc-b68b-7a7528d948a9 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:51:45.083208 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-7b98181e-b3f5-4a5e-9ee5-1f104e7194ce req-d087b31b-9ddf-4afc-b68b-7a7528d948a9 service nova] Creating event network-changed:9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff for instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 on hv-cinder-85083 Aug 03 10:51:45.090698 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-7b98181e-b3f5-4a5e-9ee5-1f104e7194ce req-d087b31b-9ddf-4afc-b68b-7a7528d948a9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041699 Aug 03 10:51:45.092159 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 492/964] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:51:45.173937 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-965b2179-fb90-4676-b4b9-c5f6b8371c12 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:51:45.185805 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-965b2179-fb90-4676-b4b9-c5f6b8371c12 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1641 microversion: 2.1 time: 0.280515 Aug 03 10:51:45.187305 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 473/965] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:51:44 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1641 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:10.911056 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=5 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:52:10.911056 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=38 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:52:10.912581 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0c5565d1-1ea5-482f-9164-59c1c8ecd849 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:52:10.915592 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0c5565d1-1ea5-482f-9164-59c1c8ecd849 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:10.923379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0c5565d1-1ea5-482f-9164-59c1c8ecd849 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:10.923831 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0c5565d1-1ea5-482f-9164-59c1c8ecd849 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:10.924622 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0c5565d1-1ea5-482f-9164-59c1c8ecd849 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:10.925058 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0c5565d1-1ea5-482f-9164-59c1c8ecd849 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:11.005569 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0c5565d1-1ea5-482f-9164-59c1c8ecd849 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "POST /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/action" status: 202 len: 0 microversion: 2.1 time: 0.099205 Aug 03 10:52:11.006191 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 493/966] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 3 10:52:10 2022] POST /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:52:11.014632 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-f4d42912-f6ab-4a2a-9d00-82ade77a877d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:11.015260 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-f4d42912-f6ab-4a2a-9d00-82ade77a877d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:11.017873 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=4 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:52:11.018548 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=8 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:52:11.029585 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f4d42912-f6ab-4a2a-9d00-82ade77a877d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:11.029938 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f4d42912-f6ab-4a2a-9d00-82ade77a877d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:11.031006 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f4d42912-f6ab-4a2a-9d00-82ade77a877d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:11.031463 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f4d42912-f6ab-4a2a-9d00-82ade77a877d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:11.235340 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f4d42912-f6ab-4a2a-9d00-82ade77a877d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:11.249964 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-f4d42912-f6ab-4a2a-9d00-82ade77a877d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1752 microversion: 2.1 time: 0.238986 Aug 03 10:52:11.250615 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 474/967] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:11 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1752 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:12.273586 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d0ae0a14-13ba-4553-99e4-faf357fb3270 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:12.274017 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d0ae0a14-13ba-4553-99e4-faf357fb3270 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:12.279933 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d0ae0a14-13ba-4553-99e4-faf357fb3270 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:12.280381 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d0ae0a14-13ba-4553-99e4-faf357fb3270 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:12.281148 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d0ae0a14-13ba-4553-99e4-faf357fb3270 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:12.281607 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d0ae0a14-13ba-4553-99e4-faf357fb3270 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:12.445365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d0ae0a14-13ba-4553-99e4-faf357fb3270 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:12.453911 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d0ae0a14-13ba-4553-99e4-faf357fb3270 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1757 microversion: 2.1 time: 0.186053 Aug 03 10:52:12.454482 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 494/968] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:12 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:13.477509 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b9e513db-6797-46a9-b9c7-3e2954695580 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:13.478148 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b9e513db-6797-46a9-b9c7-3e2954695580 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:13.484732 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b9e513db-6797-46a9-b9c7-3e2954695580 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:13.485186 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b9e513db-6797-46a9-b9c7-3e2954695580 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:13.485985 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b9e513db-6797-46a9-b9c7-3e2954695580 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:13.486461 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b9e513db-6797-46a9-b9c7-3e2954695580 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:13.651570 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b9e513db-6797-46a9-b9c7-3e2954695580 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:13.658928 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b9e513db-6797-46a9-b9c7-3e2954695580 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1757 microversion: 2.1 time: 0.186135 Aug 03 10:52:13.667314 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 475/969] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:13 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:14.685026 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bb30b02d-cddf-4f31-880e-7fe4b8c4fad7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:14.686358 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bb30b02d-cddf-4f31-880e-7fe4b8c4fad7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:14.695317 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bb30b02d-cddf-4f31-880e-7fe4b8c4fad7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:14.695881 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bb30b02d-cddf-4f31-880e-7fe4b8c4fad7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:14.696758 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bb30b02d-cddf-4f31-880e-7fe4b8c4fad7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:14.697298 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bb30b02d-cddf-4f31-880e-7fe4b8c4fad7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:14.930271 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bb30b02d-cddf-4f31-880e-7fe4b8c4fad7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:14.950140 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bb30b02d-cddf-4f31-880e-7fe4b8c4fad7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1757 microversion: 2.1 time: 0.269450 Aug 03 10:52:14.951260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 495/970] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:14 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1757 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:15.980049 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4cdf2f2b-d73c-4ee3-ab75-751f7292b84c tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:15.980789 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4cdf2f2b-d73c-4ee3-ab75-751f7292b84c tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:15.987535 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4cdf2f2b-d73c-4ee3-ab75-751f7292b84c tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:15.987988 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4cdf2f2b-d73c-4ee3-ab75-751f7292b84c tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:15.988766 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4cdf2f2b-d73c-4ee3-ab75-751f7292b84c tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:15.989265 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4cdf2f2b-d73c-4ee3-ab75-751f7292b84c tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:16.155311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4cdf2f2b-d73c-4ee3-ab75-751f7292b84c tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:16.163218 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-4cdf2f2b-d73c-4ee3-ab75-751f7292b84c tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1757 microversion: 2.1 time: 0.187581 Aug 03 10:52:16.164425 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 476/971] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:15 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:52:17.186561 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e3e84d85-f809-427e-884e-bcc94b5af1dd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:17.187172 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e3e84d85-f809-427e-884e-bcc94b5af1dd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:17.193640 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3e84d85-f809-427e-884e-bcc94b5af1dd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:17.194093 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3e84d85-f809-427e-884e-bcc94b5af1dd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:17.194865 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3e84d85-f809-427e-884e-bcc94b5af1dd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:17.195296 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3e84d85-f809-427e-884e-bcc94b5af1dd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:17.359451 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e3e84d85-f809-427e-884e-bcc94b5af1dd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:17.379469 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e3e84d85-f809-427e-884e-bcc94b5af1dd tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1757 microversion: 2.1 time: 0.196703 Aug 03 10:52:17.380054 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 496/972] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:17 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:18.401777 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-bcf49f0a-a5e6-4e07-a2b9-e3aab52c520a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:18.402397 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-bcf49f0a-a5e6-4e07-a2b9-e3aab52c520a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:18.408962 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bcf49f0a-a5e6-4e07-a2b9-e3aab52c520a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:18.409418 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bcf49f0a-a5e6-4e07-a2b9-e3aab52c520a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:18.410223 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bcf49f0a-a5e6-4e07-a2b9-e3aab52c520a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:18.410656 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-bcf49f0a-a5e6-4e07-a2b9-e3aab52c520a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:18.576465 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-bcf49f0a-a5e6-4e07-a2b9-e3aab52c520a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:18.587178 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-bcf49f0a-a5e6-4e07-a2b9-e3aab52c520a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1757 microversion: 2.1 time: 0.189256 Aug 03 10:52:18.587761 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 477/973] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:18 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:18.916123 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-22479029", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "networks": [{"uuid": "9ad2d17b-9e39-46ac-bff0-67b0dbd53889"}]}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:52:18.971478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] validate_networks() for [('9ad2d17b-9e39-46ac-bff0-67b0dbd53889', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:52:19.334785 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:52:19.335260 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:52:19.336309 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:52:19.336777 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:52:19.337237 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:52:19.346483 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:19.346931 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:19.347728 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:19.348165 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:19.365830 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Getting quotas for project f8c75fcb21364890945aead8f411c406. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:52:19.370890 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Getting quotas for user fe00592df00740cea113a9bfc2d71e76 and project f8c75fcb21364890945aead8f411c406. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:52:19.382324 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:52:19.385133 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:52:19.431872 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-40ca3b76-3c99-4be9-bba4-1ccd4751e7b3 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520014 Aug 03 10:52:19.432550 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 497/974] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:52:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:52:19.443281 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-11d82d1e-8607-47b4-a753-2a092d5dab97 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:19.444006 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-11d82d1e-8607-47b4-a753-2a092d5dab97 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:19.500070 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-11d82d1e-8607-47b4-a753-2a092d5dab97 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:19.506956 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-11d82d1e-8607-47b4-a753-2a092d5dab97 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820" status: 200 len: 1212 microversion: 2.1 time: 0.067478 Aug 03 10:52:19.508035 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 478/975] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:19 2022] GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820 => generated 1212 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:19.609545 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-40cf85e9-45b1-49f0-aa1c-9d259410db61 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:19.610167 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-40cf85e9-45b1-49f0-aa1c-9d259410db61 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:19.616761 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40cf85e9-45b1-49f0-aa1c-9d259410db61 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:19.617217 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40cf85e9-45b1-49f0-aa1c-9d259410db61 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:19.618027 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40cf85e9-45b1-49f0-aa1c-9d259410db61 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:19.618470 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40cf85e9-45b1-49f0-aa1c-9d259410db61 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:19.790134 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-40cf85e9-45b1-49f0-aa1c-9d259410db61 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:19.798683 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-40cf85e9-45b1-49f0-aa1c-9d259410db61 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1757 microversion: 2.1 time: 0.192937 Aug 03 10:52:19.799473 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 498/976] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:19 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:20.529255 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-26e8d616-81c2-4332-8d20-8402cc679ee8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:20.530486 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-26e8d616-81c2-4332-8d20-8402cc679ee8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:20.537747 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-26e8d616-81c2-4332-8d20-8402cc679ee8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:20.538292 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-26e8d616-81c2-4332-8d20-8402cc679ee8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:20.540073 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-26e8d616-81c2-4332-8d20-8402cc679ee8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:20.540654 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-26e8d616-81c2-4332-8d20-8402cc679ee8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:20.619231 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-26e8d616-81c2-4332-8d20-8402cc679ee8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:20.628773 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-26e8d616-81c2-4332-8d20-8402cc679ee8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820" status: 200 len: 1282 microversion: 2.1 time: 0.103653 Aug 03 10:52:20.629358 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 479/977] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:20 2022] GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820 => generated 1282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:52:20.820882 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a8d7d97b-333f-49d1-961e-4bfd44213b8f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:20.821733 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a8d7d97b-333f-49d1-961e-4bfd44213b8f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:20.828876 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a8d7d97b-333f-49d1-961e-4bfd44213b8f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:20.829336 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a8d7d97b-333f-49d1-961e-4bfd44213b8f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:20.830157 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a8d7d97b-333f-49d1-961e-4bfd44213b8f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:20.830600 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a8d7d97b-333f-49d1-961e-4bfd44213b8f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:20.998005 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a8d7d97b-333f-49d1-961e-4bfd44213b8f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:21.008473 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a8d7d97b-333f-49d1-961e-4bfd44213b8f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1757 microversion: 2.1 time: 0.191105 Aug 03 10:52:21.009303 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 499/978] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:20 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:21.651344 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-7c3f3a60-c4a9-4d53-95a9-018ad98fbe8d tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:21.652010 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-7c3f3a60-c4a9-4d53-95a9-018ad98fbe8d tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:21.659149 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7c3f3a60-c4a9-4d53-95a9-018ad98fbe8d tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:21.659604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7c3f3a60-c4a9-4d53-95a9-018ad98fbe8d tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:21.660396 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7c3f3a60-c4a9-4d53-95a9-018ad98fbe8d tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:21.660827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7c3f3a60-c4a9-4d53-95a9-018ad98fbe8d tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:21.821918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7c3f3a60-c4a9-4d53-95a9-018ad98fbe8d tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:21.832386 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-7c3f3a60-c4a9-4d53-95a9-018ad98fbe8d tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820" status: 200 len: 1312 microversion: 2.1 time: 0.184623 Aug 03 10:52:21.833744 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 480/979] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:21 2022] GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820 => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:21.963810 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-010143b5-ca49-40c6-b513-b04e5d153f75 req-2360740f-b63e-4f3e-b0c5-534bed6c8e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ef4965-748b-425c-b377-0bede5be0820", "tag": "c9c57901-b956-4bc9-81a8-43a979ad3d33"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:52:21.982819 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-010143b5-ca49-40c6-b513-b04e5d153f75 req-2360740f-b63e-4f3e-b0c5-534bed6c8e63 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:21.983634 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-010143b5-ca49-40c6-b513-b04e5d153f75 req-2360740f-b63e-4f3e-b0c5-534bed6c8e63 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:22.003032 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-010143b5-ca49-40c6-b513-b04e5d153f75 req-2360740f-b63e-4f3e-b0c5-534bed6c8e63 service nova] Creating event network-changed:c9c57901-b956-4bc9-81a8-43a979ad3d33 for instance 87ef4965-748b-425c-b377-0bede5be0820 on hv-cinder-85083 Aug 03 10:52:22.009842 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-010143b5-ca49-40c6-b513-b04e5d153f75 req-2360740f-b63e-4f3e-b0c5-534bed6c8e63 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052728 Aug 03 10:52:22.011206 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 500/980] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:52:22.036489 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ce0b28fa-2a03-4e3a-bd69-6346f48ead7a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:22.037817 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-ce0b28fa-2a03-4e3a-bd69-6346f48ead7a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:22.048783 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ce0b28fa-2a03-4e3a-bd69-6346f48ead7a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:22.049750 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ce0b28fa-2a03-4e3a-bd69-6346f48ead7a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:22.051333 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ce0b28fa-2a03-4e3a-bd69-6346f48ead7a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:22.052229 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ce0b28fa-2a03-4e3a-bd69-6346f48ead7a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:22.299416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-ce0b28fa-2a03-4e3a-bd69-6346f48ead7a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:22.308149 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ce0b28fa-2a03-4e3a-bd69-6346f48ead7a tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1757 microversion: 2.1 time: 0.279446 Aug 03 10:52:22.308843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 481/981] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:22 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1757 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:22.860970 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-507fd256-927f-4f3b-8d10-334ba4404846 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:22.861962 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-507fd256-927f-4f3b-8d10-334ba4404846 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:22.871961 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-507fd256-927f-4f3b-8d10-334ba4404846 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:22.872509 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-507fd256-927f-4f3b-8d10-334ba4404846 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:22.873443 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-507fd256-927f-4f3b-8d10-334ba4404846 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:22.873924 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-507fd256-927f-4f3b-8d10-334ba4404846 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:23.014556 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-507fd256-927f-4f3b-8d10-334ba4404846 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:23.024904 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-507fd256-927f-4f3b-8d10-334ba4404846 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820" status: 200 len: 1312 microversion: 2.1 time: 0.170805 Aug 03 10:52:23.025658 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 501/982] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:22 2022] GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:23.335890 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-44d1ef5d-af31-4566-bd50-294db7d2faf8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:23.336713 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-44d1ef5d-af31-4566-bd50-294db7d2faf8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:23.344388 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-44d1ef5d-af31-4566-bd50-294db7d2faf8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:23.344842 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-44d1ef5d-af31-4566-bd50-294db7d2faf8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:23.345662 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-44d1ef5d-af31-4566-bd50-294db7d2faf8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:23.346097 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-44d1ef5d-af31-4566-bd50-294db7d2faf8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:23.524352 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-44d1ef5d-af31-4566-bd50-294db7d2faf8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:23.534561 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-44d1ef5d-af31-4566-bd50-294db7d2faf8 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1757 microversion: 2.1 time: 0.205414 Aug 03 10:52:23.535362 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 482/983] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:23 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:24.046704 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2109a923-70ae-488f-b760-c22ad93c3048 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:24.047614 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2109a923-70ae-488f-b760-c22ad93c3048 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:24.055722 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2109a923-70ae-488f-b760-c22ad93c3048 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:24.056176 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2109a923-70ae-488f-b760-c22ad93c3048 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:24.056952 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2109a923-70ae-488f-b760-c22ad93c3048 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:24.057385 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2109a923-70ae-488f-b760-c22ad93c3048 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:24.196199 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2109a923-70ae-488f-b760-c22ad93c3048 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:24.203932 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2109a923-70ae-488f-b760-c22ad93c3048 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820" status: 200 len: 1312 microversion: 2.1 time: 0.162154 Aug 03 10:52:24.204520 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 502/984] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:24 2022] GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820 => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:24.556660 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c56b1320-f44a-4bde-a049-ec07dbe7adb1 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:24.557261 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-c56b1320-f44a-4bde-a049-ec07dbe7adb1 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:24.564052 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c56b1320-f44a-4bde-a049-ec07dbe7adb1 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:24.564503 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c56b1320-f44a-4bde-a049-ec07dbe7adb1 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:24.565268 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c56b1320-f44a-4bde-a049-ec07dbe7adb1 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:24.565724 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c56b1320-f44a-4bde-a049-ec07dbe7adb1 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:24.718473 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c56b1320-f44a-4bde-a049-ec07dbe7adb1 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:24.727020 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c56b1320-f44a-4bde-a049-ec07dbe7adb1 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1757 microversion: 2.1 time: 0.174148 Aug 03 10:52:24.727562 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 483/985] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:24 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:25.225883 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2d699d61-d598-4a61-83ad-98bb83d819b6 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:25.226494 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2d699d61-d598-4a61-83ad-98bb83d819b6 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:25.233956 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d699d61-d598-4a61-83ad-98bb83d819b6 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:25.234407 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d699d61-d598-4a61-83ad-98bb83d819b6 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:25.235197 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d699d61-d598-4a61-83ad-98bb83d819b6 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:25.235635 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d699d61-d598-4a61-83ad-98bb83d819b6 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:25.373102 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2d699d61-d598-4a61-83ad-98bb83d819b6 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:25.380488 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2d699d61-d598-4a61-83ad-98bb83d819b6 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820" status: 200 len: 1312 microversion: 2.1 time: 0.158428 Aug 03 10:52:25.381072 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 503/986] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:25 2022] GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820 => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:52:25.748795 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-f098b6af-c64a-4bf1-b12c-8c3fe53da521 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:25.749404 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-f098b6af-c64a-4bf1-b12c-8c3fe53da521 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:25.755898 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f098b6af-c64a-4bf1-b12c-8c3fe53da521 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:25.756346 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f098b6af-c64a-4bf1-b12c-8c3fe53da521 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:25.757138 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f098b6af-c64a-4bf1-b12c-8c3fe53da521 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:25.757602 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f098b6af-c64a-4bf1-b12c-8c3fe53da521 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:25.903081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f098b6af-c64a-4bf1-b12c-8c3fe53da521 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:25.911266 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-f098b6af-c64a-4bf1-b12c-8c3fe53da521 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1757 microversion: 2.1 time: 0.166358 Aug 03 10:52:25.911838 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 484/987] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:25 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:26.402486 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2a4761d3-d8b4-40b8-a39f-f470f89a38f9 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:26.403093 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2a4761d3-d8b4-40b8-a39f-f470f89a38f9 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:26.409911 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a4761d3-d8b4-40b8-a39f-f470f89a38f9 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:26.410400 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a4761d3-d8b4-40b8-a39f-f470f89a38f9 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:26.411174 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a4761d3-d8b4-40b8-a39f-f470f89a38f9 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:26.411605 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a4761d3-d8b4-40b8-a39f-f470f89a38f9 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:26.785933 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2a4761d3-d8b4-40b8-a39f-f470f89a38f9 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:26.794377 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2a4761d3-d8b4-40b8-a39f-f470f89a38f9 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820" status: 200 len: 1312 microversion: 2.1 time: 0.396222 Aug 03 10:52:26.794970 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 504/988] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:26 2022] GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820 => generated 1312 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:26.933910 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b582b1b0-d8e7-43c8-96de-3da2414c75d0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:26.934445 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b582b1b0-d8e7-43c8-96de-3da2414c75d0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:26.941052 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b582b1b0-d8e7-43c8-96de-3da2414c75d0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:26.941535 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b582b1b0-d8e7-43c8-96de-3da2414c75d0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:26.942311 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b582b1b0-d8e7-43c8-96de-3da2414c75d0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:26.942743 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b582b1b0-d8e7-43c8-96de-3da2414c75d0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:27.096583 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b582b1b0-d8e7-43c8-96de-3da2414c75d0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:27.106216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b582b1b0-d8e7-43c8-96de-3da2414c75d0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1757 microversion: 2.1 time: 0.177087 Aug 03 10:52:27.106908 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 485/989] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:26 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:27.816020 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e5e0b6f3-b1c4-4259-b7dd-155fe8cc5fcf tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:27.816759 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e5e0b6f3-b1c4-4259-b7dd-155fe8cc5fcf tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:27.823399 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e5e0b6f3-b1c4-4259-b7dd-155fe8cc5fcf tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:27.823849 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e5e0b6f3-b1c4-4259-b7dd-155fe8cc5fcf tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:27.824625 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e5e0b6f3-b1c4-4259-b7dd-155fe8cc5fcf tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:27.825094 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e5e0b6f3-b1c4-4259-b7dd-155fe8cc5fcf tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:27.955466 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e5e0b6f3-b1c4-4259-b7dd-155fe8cc5fcf tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:27.963141 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e5e0b6f3-b1c4-4259-b7dd-155fe8cc5fcf tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820" status: 200 len: 1312 microversion: 2.1 time: 0.150978 Aug 03 10:52:27.963709 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 505/990] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:27 2022] GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:28.135894 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-140db3c0-679a-4d3b-8a8f-ef3763f16f75 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:28.136448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-140db3c0-679a-4d3b-8a8f-ef3763f16f75 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:28.142949 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-140db3c0-679a-4d3b-8a8f-ef3763f16f75 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:28.143393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-140db3c0-679a-4d3b-8a8f-ef3763f16f75 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:28.144153 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-140db3c0-679a-4d3b-8a8f-ef3763f16f75 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:28.144581 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-140db3c0-679a-4d3b-8a8f-ef3763f16f75 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:28.290835 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-140db3c0-679a-4d3b-8a8f-ef3763f16f75 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:28.298913 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-140db3c0-679a-4d3b-8a8f-ef3763f16f75 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1760 microversion: 2.1 time: 0.167020 Aug 03 10:52:28.299471 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 486/991] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:28 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:28.768943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-5f04a5c1-d7e9-4b7b-8cce-faec086a2d81 req-ea065188-4fe9-45a0-8349-e62ad692e316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ef4965-748b-425c-b377-0bede5be0820", "name": "network-vif-plugged", "status": "completed", "tag": "c9c57901-b956-4bc9-81a8-43a979ad3d33"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:52:28.779870 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-5f04a5c1-d7e9-4b7b-8cce-faec086a2d81 req-ea065188-4fe9-45a0-8349-e62ad692e316 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:28.779870 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-5f04a5c1-d7e9-4b7b-8cce-faec086a2d81 req-ea065188-4fe9-45a0-8349-e62ad692e316 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:28.793175 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-5f04a5c1-d7e9-4b7b-8cce-faec086a2d81 req-ea065188-4fe9-45a0-8349-e62ad692e316 service nova] Creating event network-vif-plugged:c9c57901-b956-4bc9-81a8-43a979ad3d33 for instance 87ef4965-748b-425c-b377-0bede5be0820 on hv-cinder-85083 Aug 03 10:52:28.798454 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-5f04a5c1-d7e9-4b7b-8cce-faec086a2d81 req-ea065188-4fe9-45a0-8349-e62ad692e316 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033569 Aug 03 10:52:28.799076 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 506/992] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:52:28.983329 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b85415a0-fca6-4d11-a86c-6cc77f1b0188 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:28.983941 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b85415a0-fca6-4d11-a86c-6cc77f1b0188 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:28.990117 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b85415a0-fca6-4d11-a86c-6cc77f1b0188 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:28.990558 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b85415a0-fca6-4d11-a86c-6cc77f1b0188 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:28.991586 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b85415a0-fca6-4d11-a86c-6cc77f1b0188 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:28.992038 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b85415a0-fca6-4d11-a86c-6cc77f1b0188 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:29.132200 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b85415a0-fca6-4d11-a86c-6cc77f1b0188 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:29.140172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b85415a0-fca6-4d11-a86c-6cc77f1b0188 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820" status: 200 len: 1312 microversion: 2.1 time: 0.160678 Aug 03 10:52:29.140826 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 487/993] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:28 2022] GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820 => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:30.158649 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:52:30.159419 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=6 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:52:30.164004 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-678a51a2-9047-47c7-ae94-866c74f32e1a tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:30.164698 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-678a51a2-9047-47c7-ae94-866c74f32e1a tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:30.172278 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-678a51a2-9047-47c7-ae94-866c74f32e1a tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:30.172721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-678a51a2-9047-47c7-ae94-866c74f32e1a tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:30.173492 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-678a51a2-9047-47c7-ae94-866c74f32e1a tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:30.173991 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-678a51a2-9047-47c7-ae94-866c74f32e1a tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:30.303523 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-678a51a2-9047-47c7-ae94-866c74f32e1a tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:30.312176 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-678a51a2-9047-47c7-ae94-866c74f32e1a tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820" status: 200 len: 1495 microversion: 2.1 time: 0.154998 Aug 03 10:52:30.312871 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 507/994] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:30 2022] GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820 => generated 1495 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:30.713601 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4e75f1e3-126b-4463-af3c-87aaac6c4d28 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:30.714160 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4e75f1e3-126b-4463-af3c-87aaac6c4d28 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:30.716498 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:52:30.722137 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4e75f1e3-126b-4463-af3c-87aaac6c4d28 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:30.722545 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4e75f1e3-126b-4463-af3c-87aaac6c4d28 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:30.723291 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4e75f1e3-126b-4463-af3c-87aaac6c4d28 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:30.723720 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4e75f1e3-126b-4463-af3c-87aaac6c4d28 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:30.748501 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4e75f1e3-126b-4463-af3c-87aaac6c4d28 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] Going to try to terminate instance {{(pid=124389) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:52:30.822476 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-4e75f1e3-126b-4463-af3c-87aaac6c4d28 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "DELETE /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820" status: 204 len: 0 microversion: 2.1 time: 0.113170 Aug 03 10:52:30.823175 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 488/995] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:52:30 2022] DELETE /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:52:30.831290 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-50a9238a-200e-4269-9dfc-42d2357a394f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:30.831903 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-50a9238a-200e-4269-9dfc-42d2357a394f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:30.838629 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-50a9238a-200e-4269-9dfc-42d2357a394f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:30.839077 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-50a9238a-200e-4269-9dfc-42d2357a394f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:30.839850 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-50a9238a-200e-4269-9dfc-42d2357a394f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:30.840281 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-50a9238a-200e-4269-9dfc-42d2357a394f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:30.975785 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-50a9238a-200e-4269-9dfc-42d2357a394f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:30.983470 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-50a9238a-200e-4269-9dfc-42d2357a394f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820" status: 200 len: 1501 microversion: 2.1 time: 0.155955 Aug 03 10:52:30.984076 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 508/996] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:30 2022] GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820 => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:52:32.006148 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-80a65de0-8e62-40b9-8b4c-8b3f211bf68f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:32.006849 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-80a65de0-8e62-40b9-8b4c-8b3f211bf68f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:32.014131 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-80a65de0-8e62-40b9-8b4c-8b3f211bf68f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:32.014584 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-80a65de0-8e62-40b9-8b4c-8b3f211bf68f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:32.015354 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-80a65de0-8e62-40b9-8b4c-8b3f211bf68f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:32.015791 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-80a65de0-8e62-40b9-8b4c-8b3f211bf68f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:32.148251 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-80a65de0-8e62-40b9-8b4c-8b3f211bf68f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:32.151895 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:52:32.156430 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-80a65de0-8e62-40b9-8b4c-8b3f211bf68f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820" status: 200 len: 1501 microversion: 2.1 time: 0.154557 Aug 03 10:52:32.157010 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 489/997] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:32 2022] GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:32.588520 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-10dbdffa-82b0-4e4c-9463-5c448840cee1 req-97623dd4-6139-47bc-b4b5-9a362c31e92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ef4965-748b-425c-b377-0bede5be0820", "name": "network-vif-deleted", "tag": "c9c57901-b956-4bc9-81a8-43a979ad3d33"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:52:32.599188 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-10dbdffa-82b0-4e4c-9463-5c448840cee1 req-97623dd4-6139-47bc-b4b5-9a362c31e92c service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:32.599555 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-10dbdffa-82b0-4e4c-9463-5c448840cee1 req-97623dd4-6139-47bc-b4b5-9a362c31e92c service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:32.611292 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-10dbdffa-82b0-4e4c-9463-5c448840cee1 req-97623dd4-6139-47bc-b4b5-9a362c31e92c service nova] Creating event network-vif-deleted:c9c57901-b956-4bc9-81a8-43a979ad3d33 for instance 87ef4965-748b-425c-b377-0bede5be0820 on hv-cinder-85083 Aug 03 10:52:32.616640 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-10dbdffa-82b0-4e4c-9463-5c448840cee1 req-97623dd4-6139-47bc-b4b5-9a362c31e92c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031587 Aug 03 10:52:32.617266 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 509/998] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:52:33.177896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-78634a57-e494-41ea-b94c-eaac20df96e2 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:33.178443 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-78634a57-e494-41ea-b94c-eaac20df96e2 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 87ef4965-748b-425c-b377-0bede5be0820] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:33.186839 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-78634a57-e494-41ea-b94c-eaac20df96e2 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:33.187288 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-78634a57-e494-41ea-b94c-eaac20df96e2 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:33.188055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-78634a57-e494-41ea-b94c-eaac20df96e2 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:33.188489 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-78634a57-e494-41ea-b94c-eaac20df96e2 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:33.202937 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-78634a57-e494-41ea-b94c-eaac20df96e2 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] HTTP exception thrown: Instance 87ef4965-748b-425c-b377-0bede5be0820 could not be found. Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-78634a57-e494-41ea-b94c-eaac20df96e2 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Request method failure captured: Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820 HTTP/1.1 Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lNhbQb6JhV0o_OpKHQVXELrKBl7jzRdjZgP3NHSRXYgkPgRMWDQtECIKXVr4hq5SZ8I__hr9YD7XWYaJfyedJx-udAMp-zWQkvH0xowyiY57_sh9oEYOf0GZJGkeDMdoRFddoMqrV86C9RtpCcyIr746fs_Zrq501DIrvIwesPy1do Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: f8c75fcb21364890945aead8f411c406 Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-VolumesActionsTest-1475038784 Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:52:33.204604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:52:33.206360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8c75fcb21364890945aead8f411c406"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f8c75fcb21364890945aead8f411c406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8c75fcb21364890945aead8f411c406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f8c75fcb21364890945aead8f411c406", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:52:33.206360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-VolumesActionsTest-1475038784 Aug 03 10:52:33.206360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: f8c75fcb21364890945aead8f411c406 Aug 03 10:52:33.206360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-VolumesActionsTest-1475038784 Aug 03 10:52:33.206360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-VolumesActionsTest-1475038784-project Aug 03 10:52:33.206360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:52:33.206360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:52:33.206360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: fe00592df00740cea113a9bfc2d71e76 Aug 03 10:52:33.206360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-VolumesActionsTest-1475038784-project Aug 03 10:52:33.206360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:52:33.206360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 87ef4965-748b-425c-b377-0bede5be0820 could not be found. Aug 03 10:52:33.206360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '87ef4965-748b-425c-b377-0bede5be0820'} Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87ef4965-748b-425c-b377-0bede5be0820 could not be found. Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:52:33.207393 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87ef4965-748b-425c-b377-0bede5be0820 could not be found. Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87ef4965-748b-425c-b377-0bede5be0820 could not be found. Aug 03 10:52:33.208983 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:52:33.210449 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-78634a57-e494-41ea-b94c-eaac20df96e2 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Returning 404 to user: Instance 87ef4965-748b-425c-b377-0bede5be0820 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:52:33.210449 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-78634a57-e494-41ea-b94c-eaac20df96e2 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820" status: 404 len: 111 microversion: 2.1 time: 0.032167 Aug 03 10:52:33.210449 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 490/999] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:33 2022] GET /compute/v2.1/servers/87ef4965-748b-425c-b377-0bede5be0820 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:52:33.257406 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-446244545", "imageRef": "b362ece4-f33d-4cb8-8ecd-96eac9880b4f", "flavorRef": "452", "networks": [{"uuid": "9ad2d17b-9e39-46ac-bff0-67b0dbd53889"}]}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:52:33.311699 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] validate_networks() for [('9ad2d17b-9e39-46ac-bff0-67b0dbd53889', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:52:33.659585 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:52:33.660242 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:52:33.660468 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:52:33.660870 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:52:33.661316 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:52:33.670844 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:33.671288 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:33.672082 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:33.672516 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:33.689393 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Getting quotas for project f8c75fcb21364890945aead8f411c406. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:52:33.693294 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Getting quotas for user fe00592df00740cea113a9bfc2d71e76 and project f8c75fcb21364890945aead8f411c406. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:52:33.706373 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:52:33.708751 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b362ece4-f33d-4cb8-8ecd-96eac9880b4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:52:33.756845 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-118a6fad-3f88-4de2-8669-5d73a4b4fa4b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503577 Aug 03 10:52:33.757497 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 510/1000] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:52:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:52:33.768887 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b41024f7-9b24-4f91-b3b0-142cb9e7361b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:33.769518 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b41024f7-9b24-4f91-b3b0-142cb9e7361b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:33.823277 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b41024f7-9b24-4f91-b3b0-142cb9e7361b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:33.829945 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b41024f7-9b24-4f91-b3b0-142cb9e7361b tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 200 len: 1213 microversion: 2.1 time: 0.064885 Aug 03 10:52:33.830888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 491/1001] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:33 2022] GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:34.851922 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f99a1dd8-d4c6-4d7f-b9ea-f85ac3c4500f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:34.853119 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f99a1dd8-d4c6-4d7f-b9ea-f85ac3c4500f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:34.859733 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f99a1dd8-d4c6-4d7f-b9ea-f85ac3c4500f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:34.860188 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f99a1dd8-d4c6-4d7f-b9ea-f85ac3c4500f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:34.860959 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f99a1dd8-d4c6-4d7f-b9ea-f85ac3c4500f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:34.861398 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f99a1dd8-d4c6-4d7f-b9ea-f85ac3c4500f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:34.929793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f99a1dd8-d4c6-4d7f-b9ea-f85ac3c4500f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:34.933501 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:52:34.938423 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f99a1dd8-d4c6-4d7f-b9ea-f85ac3c4500f tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 200 len: 1271 microversion: 2.1 time: 0.090894 Aug 03 10:52:34.938995 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 511/1002] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:34 2022] GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:35.959389 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1956d3dd-e900-45c3-8d4d-738527d067cb tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:35.960717 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-1956d3dd-e900-45c3-8d4d-738527d067cb tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:35.970113 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-4b6e2d5c-40eb-4c50-b8e4-d74550b0c6ab req-a7e782e4-fc1b-4f28-b373-30da8e89ae5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c75460e-651b-4409-9a1e-1d0fb321ca57", "tag": "99c1b103-1472-4743-aa09-09c27b8054c4"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:52:35.970940 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1956d3dd-e900-45c3-8d4d-738527d067cb tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:35.971122 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1956d3dd-e900-45c3-8d4d-738527d067cb tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:35.972167 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1956d3dd-e900-45c3-8d4d-738527d067cb tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:35.972810 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1956d3dd-e900-45c3-8d4d-738527d067cb tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:35.985806 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-4b6e2d5c-40eb-4c50-b8e4-d74550b0c6ab req-a7e782e4-fc1b-4f28-b373-30da8e89ae5f service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:35.987468 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-4b6e2d5c-40eb-4c50-b8e4-d74550b0c6ab req-a7e782e4-fc1b-4f28-b373-30da8e89ae5f service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:36.003781 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-4b6e2d5c-40eb-4c50-b8e4-d74550b0c6ab req-a7e782e4-fc1b-4f28-b373-30da8e89ae5f service nova] Creating event network-changed:99c1b103-1472-4743-aa09-09c27b8054c4 for instance 3c75460e-651b-4409-9a1e-1d0fb321ca57 on hv-cinder-85083 Aug 03 10:52:36.009254 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-4b6e2d5c-40eb-4c50-b8e4-d74550b0c6ab req-a7e782e4-fc1b-4f28-b373-30da8e89ae5f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043331 Aug 03 10:52:36.010116 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 512/1003] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:52:36.124460 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1956d3dd-e900-45c3-8d4d-738527d067cb tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:36.133448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1956d3dd-e900-45c3-8d4d-738527d067cb tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 200 len: 1313 microversion: 2.1 time: 0.177881 Aug 03 10:52:36.134124 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 492/1004] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:35 2022] GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:37.157614 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-80ec7483-43ee-42cc-9e3f-d89e75bd7503 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:37.158307 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-80ec7483-43ee-42cc-9e3f-d89e75bd7503 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:37.164650 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-80ec7483-43ee-42cc-9e3f-d89e75bd7503 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:37.165147 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-80ec7483-43ee-42cc-9e3f-d89e75bd7503 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:37.165948 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-80ec7483-43ee-42cc-9e3f-d89e75bd7503 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:37.166375 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-80ec7483-43ee-42cc-9e3f-d89e75bd7503 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:37.302600 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-80ec7483-43ee-42cc-9e3f-d89e75bd7503 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:37.315251 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-80ec7483-43ee-42cc-9e3f-d89e75bd7503 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 200 len: 1313 microversion: 2.1 time: 0.158062 Aug 03 10:52:37.315251 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 513/1005] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:37 2022] GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:38.334705 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-f4706b62-dd40-4c29-8f35-1765c6db0dab tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:38.335335 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-f4706b62-dd40-4c29-8f35-1765c6db0dab tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:38.342159 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f4706b62-dd40-4c29-8f35-1765c6db0dab tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:38.342604 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f4706b62-dd40-4c29-8f35-1765c6db0dab tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:38.343362 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f4706b62-dd40-4c29-8f35-1765c6db0dab tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:38.343791 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-f4706b62-dd40-4c29-8f35-1765c6db0dab tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:38.476711 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f4706b62-dd40-4c29-8f35-1765c6db0dab tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:38.486065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-f4706b62-dd40-4c29-8f35-1765c6db0dab tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 200 len: 1313 microversion: 2.1 time: 0.155074 Aug 03 10:52:38.486654 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 493/1006] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:38 2022] GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:39.507048 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7b6f2fc7-9708-4a0f-9f0f-0762af94c7ed tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:39.507679 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7b6f2fc7-9708-4a0f-9f0f-0762af94c7ed tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:39.514792 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7b6f2fc7-9708-4a0f-9f0f-0762af94c7ed tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:39.515237 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7b6f2fc7-9708-4a0f-9f0f-0762af94c7ed tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:39.515989 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7b6f2fc7-9708-4a0f-9f0f-0762af94c7ed tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:39.516416 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7b6f2fc7-9708-4a0f-9f0f-0762af94c7ed tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:39.643542 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7b6f2fc7-9708-4a0f-9f0f-0762af94c7ed tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:39.651442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7b6f2fc7-9708-4a0f-9f0f-0762af94c7ed tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 200 len: 1313 microversion: 2.1 time: 0.148144 Aug 03 10:52:39.652010 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 514/1007] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:39 2022] GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:40.671178 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b8f90278-9755-4d96-897d-bb36159273c7 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:40.671882 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b8f90278-9755-4d96-897d-bb36159273c7 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:40.678702 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b8f90278-9755-4d96-897d-bb36159273c7 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:40.679145 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b8f90278-9755-4d96-897d-bb36159273c7 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:40.679926 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b8f90278-9755-4d96-897d-bb36159273c7 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:40.680355 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b8f90278-9755-4d96-897d-bb36159273c7 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:40.830188 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b8f90278-9755-4d96-897d-bb36159273c7 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:40.838398 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b8f90278-9755-4d96-897d-bb36159273c7 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 200 len: 1313 microversion: 2.1 time: 0.170880 Aug 03 10:52:40.839057 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 494/1008] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:40 2022] GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:41.859423 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-251e2159-4cc5-4c1b-9704-63bfd6a2eca4 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:41.860030 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-251e2159-4cc5-4c1b-9704-63bfd6a2eca4 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:41.862497 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:52:41.868825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-251e2159-4cc5-4c1b-9704-63bfd6a2eca4 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:41.869271 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-251e2159-4cc5-4c1b-9704-63bfd6a2eca4 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:41.870235 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-251e2159-4cc5-4c1b-9704-63bfd6a2eca4 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:41.870673 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-251e2159-4cc5-4c1b-9704-63bfd6a2eca4 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:42.004835 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-251e2159-4cc5-4c1b-9704-63bfd6a2eca4 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:42.012465 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-251e2159-4cc5-4c1b-9704-63bfd6a2eca4 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 200 len: 1313 microversion: 2.1 time: 0.156877 Aug 03 10:52:42.013037 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 515/1009] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:41 2022] GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:42.820702 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-062096c5-583f-4622-bd13-e4f3c619a74f req-acc464e4-9044-4fea-89a8-21f40954cd09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c75460e-651b-4409-9a1e-1d0fb321ca57", "name": "network-vif-plugged", "status": "completed", "tag": "99c1b103-1472-4743-aa09-09c27b8054c4"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:52:42.827006 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:52:42.833366 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-062096c5-583f-4622-bd13-e4f3c619a74f req-acc464e4-9044-4fea-89a8-21f40954cd09 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:42.833840 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-062096c5-583f-4622-bd13-e4f3c619a74f req-acc464e4-9044-4fea-89a8-21f40954cd09 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:42.847151 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-062096c5-583f-4622-bd13-e4f3c619a74f req-acc464e4-9044-4fea-89a8-21f40954cd09 service nova] Creating event network-vif-plugged:99c1b103-1472-4743-aa09-09c27b8054c4 for instance 3c75460e-651b-4409-9a1e-1d0fb321ca57 on hv-cinder-85083 Aug 03 10:52:42.852570 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-062096c5-583f-4622-bd13-e4f3c619a74f req-acc464e4-9044-4fea-89a8-21f40954cd09 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035778 Aug 03 10:52:42.853186 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 495/1010] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:52:43.032847 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-082cf0f6-de22-4cbd-bf46-909a01cde261 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:43.033459 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-082cf0f6-de22-4cbd-bf46-909a01cde261 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:43.040567 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-082cf0f6-de22-4cbd-bf46-909a01cde261 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:43.041018 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-082cf0f6-de22-4cbd-bf46-909a01cde261 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:43.041851 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-082cf0f6-de22-4cbd-bf46-909a01cde261 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:43.042283 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-082cf0f6-de22-4cbd-bf46-909a01cde261 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:43.181498 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-082cf0f6-de22-4cbd-bf46-909a01cde261 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:43.190930 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-082cf0f6-de22-4cbd-bf46-909a01cde261 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 200 len: 1313 microversion: 2.1 time: 0.162090 Aug 03 10:52:43.191550 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 516/1011] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:43 2022] GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:44.209770 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:52:44.214600 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2fed9f89-c6dd-42c6-894c-8e3916acaa11 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:44.215313 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2fed9f89-c6dd-42c6-894c-8e3916acaa11 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:44.222197 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fed9f89-c6dd-42c6-894c-8e3916acaa11 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:44.222575 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fed9f89-c6dd-42c6-894c-8e3916acaa11 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:44.223358 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fed9f89-c6dd-42c6-894c-8e3916acaa11 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:44.223792 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2fed9f89-c6dd-42c6-894c-8e3916acaa11 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:44.370957 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2fed9f89-c6dd-42c6-894c-8e3916acaa11 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:44.379781 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2fed9f89-c6dd-42c6-894c-8e3916acaa11 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 200 len: 1313 microversion: 2.1 time: 0.170880 Aug 03 10:52:44.380382 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 496/1012] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:44 2022] GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:45.401170 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c74709a4-483e-4984-a957-533e0d333f13 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:45.401807 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c74709a4-483e-4984-a957-533e0d333f13 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:45.403650 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:52:45.404381 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=6 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:52:45.410323 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c74709a4-483e-4984-a957-533e0d333f13 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:45.410773 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c74709a4-483e-4984-a957-533e0d333f13 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:45.411538 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c74709a4-483e-4984-a957-533e0d333f13 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:45.411971 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c74709a4-483e-4984-a957-533e0d333f13 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:45.542105 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c74709a4-483e-4984-a957-533e0d333f13 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:45.549983 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c74709a4-483e-4984-a957-533e0d333f13 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 200 len: 1496 microversion: 2.1 time: 0.153217 Aug 03 10:52:45.550548 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 517/1013] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:45 2022] GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 1496 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:45.974501 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-73c1f4b3-9dab-44f6-9cce-cd653aa86c40 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:45.975002 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-73c1f4b3-9dab-44f6-9cce-cd653aa86c40 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:45.982093 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-73c1f4b3-9dab-44f6-9cce-cd653aa86c40 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:45.982541 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-73c1f4b3-9dab-44f6-9cce-cd653aa86c40 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:45.983305 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-73c1f4b3-9dab-44f6-9cce-cd653aa86c40 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:45.983736 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-73c1f4b3-9dab-44f6-9cce-cd653aa86c40 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:46.008723 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-73c1f4b3-9dab-44f6-9cce-cd653aa86c40 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Going to try to terminate instance {{(pid=124389) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:52:46.083834 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-73c1f4b3-9dab-44f6-9cce-cd653aa86c40 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 204 len: 0 microversion: 2.1 time: 0.112864 Aug 03 10:52:46.084516 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 497/1014] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:52:45 2022] DELETE /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:52:46.093455 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-62c10499-aa99-4d1e-876d-78f51c107811 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:46.094103 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-62c10499-aa99-4d1e-876d-78f51c107811 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:46.100149 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-62c10499-aa99-4d1e-876d-78f51c107811 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:46.100602 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-62c10499-aa99-4d1e-876d-78f51c107811 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:46.101370 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-62c10499-aa99-4d1e-876d-78f51c107811 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:46.101871 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-62c10499-aa99-4d1e-876d-78f51c107811 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:46.236572 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-62c10499-aa99-4d1e-876d-78f51c107811 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:46.245041 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-62c10499-aa99-4d1e-876d-78f51c107811 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 200 len: 1502 microversion: 2.1 time: 0.155373 Aug 03 10:52:46.245674 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 518/1015] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:46 2022] GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:52:47.267271 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5fa4f4ad-61d7-4989-b121-5ba5b07889ad tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:47.267964 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-5fa4f4ad-61d7-4989-b121-5ba5b07889ad tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:47.274429 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5fa4f4ad-61d7-4989-b121-5ba5b07889ad tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:47.274867 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5fa4f4ad-61d7-4989-b121-5ba5b07889ad tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:47.275622 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5fa4f4ad-61d7-4989-b121-5ba5b07889ad tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:47.276046 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5fa4f4ad-61d7-4989-b121-5ba5b07889ad tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:47.417723 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5fa4f4ad-61d7-4989-b121-5ba5b07889ad tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:47.425499 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5fa4f4ad-61d7-4989-b121-5ba5b07889ad tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 200 len: 1502 microversion: 2.1 time: 0.162509 Aug 03 10:52:47.426070 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 498/1016] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:47 2022] GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:48.264239 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-7fb32738-4188-4036-ac47-05b08b5f5de1 req-50fc97d4-fc14-4c34-a991-d18252df7b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c75460e-651b-4409-9a1e-1d0fb321ca57", "name": "network-vif-deleted", "tag": "99c1b103-1472-4743-aa09-09c27b8054c4"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:52:48.275325 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-7fb32738-4188-4036-ac47-05b08b5f5de1 req-50fc97d4-fc14-4c34-a991-d18252df7b1d service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:48.275673 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-7fb32738-4188-4036-ac47-05b08b5f5de1 req-50fc97d4-fc14-4c34-a991-d18252df7b1d service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:48.287828 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-7fb32738-4188-4036-ac47-05b08b5f5de1 req-50fc97d4-fc14-4c34-a991-d18252df7b1d service nova] Creating event network-vif-deleted:99c1b103-1472-4743-aa09-09c27b8054c4 for instance 3c75460e-651b-4409-9a1e-1d0fb321ca57 on hv-cinder-85083 Aug 03 10:52:48.293458 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-7fb32738-4188-4036-ac47-05b08b5f5de1 req-50fc97d4-fc14-4c34-a991-d18252df7b1d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032641 Aug 03 10:52:48.294098 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 519/1017] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:52:48.447796 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-095b6217-2393-4a9b-ba90-849a337772a8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:48.448435 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-095b6217-2393-4a9b-ba90-849a337772a8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:48.455052 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-095b6217-2393-4a9b-ba90-849a337772a8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:48.455501 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-095b6217-2393-4a9b-ba90-849a337772a8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:48.456269 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-095b6217-2393-4a9b-ba90-849a337772a8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:48.456704 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-095b6217-2393-4a9b-ba90-849a337772a8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:48.488222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-095b6217-2393-4a9b-ba90-849a337772a8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:48.488661 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-095b6217-2393-4a9b-ba90-849a337772a8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:48.489110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-095b6217-2393-4a9b-ba90-849a337772a8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lazy-loading 'fault' on Instance uuid 3c75460e-651b-4409-9a1e-1d0fb321ca57 {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:52:48.530350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-095b6217-2393-4a9b-ba90-849a337772a8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe00592df00740cea113a9bfc2d71e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c75fcb21364890945aead8f411c406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:52:48.537847 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-095b6217-2393-4a9b-ba90-849a337772a8 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 200 len: 1303 microversion: 2.1 time: 0.094675 Aug 03 10:52:48.538409 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 499/1018] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:48 2022] GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:52:49.560424 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a654a106-e70a-414f-8da6-fec8e4113531 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:52:49.561233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a654a106-e70a-414f-8da6-fec8e4113531 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] [instance: 3c75460e-651b-4409-9a1e-1d0fb321ca57] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:52:49.567616 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a654a106-e70a-414f-8da6-fec8e4113531 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:49.568070 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a654a106-e70a-414f-8da6-fec8e4113531 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:49.568848 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a654a106-e70a-414f-8da6-fec8e4113531 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:52:49.569286 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a654a106-e70a-414f-8da6-fec8e4113531 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:52:49.584426 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-a654a106-e70a-414f-8da6-fec8e4113531 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] HTTP exception thrown: Instance 3c75460e-651b-4409-9a1e-1d0fb321ca57 could not be found. Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a654a106-e70a-414f-8da6-fec8e4113531 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Request method failure captured: Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 HTTP/1.1 Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lNhbQb6JhV0o_OpKHQVXELrKBl7jzRdjZgP3NHSRXYgkPgRMWDQtECIKXVr4hq5SZ8I__hr9YD7XWYaJfyedJx-udAMp-zWQkvH0xowyiY57_sh9oEYOf0GZJGkeDMdoRFddoMqrV86C9RtpCcyIr746fs_Zrq501DIrvIwesPy1do Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: f8c75fcb21364890945aead8f411c406 Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesActionsTest-1475038784 Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:52:49.586121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:52:49.588431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8c75fcb21364890945aead8f411c406"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f8c75fcb21364890945aead8f411c406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8c75fcb21364890945aead8f411c406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f8c75fcb21364890945aead8f411c406", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:52:49.588431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesActionsTest-1475038784 Aug 03 10:52:49.588431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: f8c75fcb21364890945aead8f411c406 Aug 03 10:52:49.588431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesActionsTest-1475038784 Aug 03 10:52:49.588431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesActionsTest-1475038784-project Aug 03 10:52:49.588431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:52:49.588431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:52:49.588431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: fe00592df00740cea113a9bfc2d71e76 Aug 03 10:52:49.588431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesActionsTest-1475038784-project Aug 03 10:52:49.588431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:52:49.588431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance 3c75460e-651b-4409-9a1e-1d0fb321ca57 could not be found. Aug 03 10:52:49.588431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': '3c75460e-651b-4409-9a1e-1d0fb321ca57'} Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c75460e-651b-4409-9a1e-1d0fb321ca57 could not be found. Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:52:49.589869 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c75460e-651b-4409-9a1e-1d0fb321ca57 could not be found. Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c75460e-651b-4409-9a1e-1d0fb321ca57 could not be found. Aug 03 10:52:49.592467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:52:49.595092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a654a106-e70a-414f-8da6-fec8e4113531 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] Returning 404 to user: Instance 3c75460e-651b-4409-9a1e-1d0fb321ca57 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:52:49.595092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a654a106-e70a-414f-8da6-fec8e4113531 tempest-VolumesActionsTest-1475038784 tempest-VolumesActionsTest-1475038784-project] 10.222.0.47 "GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57" status: 404 len: 111 microversion: 2.1 time: 0.033229 Aug 03 10:52:49.595092 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 520/1019] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:52:49 2022] GET /compute/v2.1/servers/3c75460e-651b-4409-9a1e-1d0fb321ca57 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:53:04.230085 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ba24c2e0-2884-49db-b493-85631e014fa7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2142719830"}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:53:04.230738 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-ba24c2e0-2884-49db-b493-85631e014fa7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:04.233298 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:53:04.234497 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:53:04.244970 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ba24c2e0-2884-49db-b493-85631e014fa7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:04.245423 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ba24c2e0-2884-49db-b493-85631e014fa7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:04.246888 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ba24c2e0-2884-49db-b493-85631e014fa7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:04.247360 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ba24c2e0-2884-49db-b493-85631e014fa7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:04.416603 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.network.security_group_api [None req-ba24c2e0-2884-49db-b493-85631e014fa7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Removing security group 74cefa62-05ee-41ca-bd54-d2973076256c from port 9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff Aug 03 10:53:04.845021 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ba24c2e0-2884-49db-b493-85631e014fa7 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "POST /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/action" status: 202 len: 0 microversion: 2.1 time: 0.619798 Aug 03 10:53:04.848678 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 500/1020] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 3 10:53:04 2022] POST /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/action => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:53:04.889071 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-6faa1bfe-ec40-4efa-a9c7-ac12c12b833f req-7a4c593f-fbc3-4ab3-b21f-f9884d1f7b35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a25924-4ed2-43e0-85ff-bc4b9ad88387", "tag": "9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:53:04.916388 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=11 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:53:04.918118 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=42 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:53:04.920945 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-6faa1bfe-ec40-4efa-a9c7-ac12c12b833f req-7a4c593f-fbc3-4ab3-b21f-f9884d1f7b35 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:04.921698 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-6faa1bfe-ec40-4efa-a9c7-ac12c12b833f req-7a4c593f-fbc3-4ab3-b21f-f9884d1f7b35 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:04.938312 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-6faa1bfe-ec40-4efa-a9c7-ac12c12b833f req-7a4c593f-fbc3-4ab3-b21f-f9884d1f7b35 service nova] Creating event network-changed:9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff for instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 on hv-cinder-85083 Aug 03 10:53:04.953372 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-6faa1bfe-ec40-4efa-a9c7-ac12c12b833f req-7a4c593f-fbc3-4ab3-b21f-f9884d1f7b35 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059516 Aug 03 10:53:04.954839 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 521/1021] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:53:06.448240 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-7531161a-ae75-4cc1-9af2-8bd5c4e3909d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:06.448891 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-7531161a-ae75-4cc1-9af2-8bd5c4e3909d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:06.458174 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7531161a-ae75-4cc1-9af2-8bd5c4e3909d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:06.458545 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7531161a-ae75-4cc1-9af2-8bd5c4e3909d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:06.459554 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7531161a-ae75-4cc1-9af2-8bd5c4e3909d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:06.460156 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-7531161a-ae75-4cc1-9af2-8bd5c4e3909d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:06.559468 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.objects.instance [None req-7531161a-ae75-4cc1-9af2-8bd5c4e3909d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lazy-loading 'services' on Instance uuid 00a25924-4ed2-43e0-85ff-bc4b9ad88387 {{(pid=124389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:53:06.675262 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-7531161a-ae75-4cc1-9af2-8bd5c4e3909d tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "DELETE /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/os-volume_attachments/9b597270-e3a1-47f8-b003-bc7eaa3d4e3c" status: 202 len: 0 microversion: 2.1 time: 0.228101 Aug 03 10:53:06.676653 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 501/1022] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 3 10:53:06 2022] DELETE /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/os-volume_attachments/9b597270-e3a1-47f8-b003-bc7eaa3d4e3c => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:53:06.690801 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c0666b53-a3b6-4a15-ab71-6a74d34460d0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:06.697335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c0666b53-a3b6-4a15-ab71-6a74d34460d0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:06.706136 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c0666b53-a3b6-4a15-ab71-6a74d34460d0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:06.720107 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c0666b53-a3b6-4a15-ab71-6a74d34460d0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:06.722015 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c0666b53-a3b6-4a15-ab71-6a74d34460d0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:06.724291 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c0666b53-a3b6-4a15-ab71-6a74d34460d0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:06.782951 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c0666b53-a3b6-4a15-ab71-6a74d34460d0 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099866 Aug 03 10:53:06.787699 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 522/1023] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:53:06 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:53:06.972894 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-67201823-73fa-4faf-8f56-65ef48332037 req-0c441504-8fa8-40b4-ab4f-6fe47ab9ee3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a25924-4ed2-43e0-85ff-bc4b9ad88387", "tag": "9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:53:06.985389 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-67201823-73fa-4faf-8f56-65ef48332037 req-0c441504-8fa8-40b4-ab4f-6fe47ab9ee3c service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:06.986034 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-67201823-73fa-4faf-8f56-65ef48332037 req-0c441504-8fa8-40b4-ab4f-6fe47ab9ee3c service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:07.000522 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-67201823-73fa-4faf-8f56-65ef48332037 req-0c441504-8fa8-40b4-ab4f-6fe47ab9ee3c service nova] Creating event network-changed:9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff for instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 on hv-cinder-85083 Aug 03 10:53:07.010827 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-67201823-73fa-4faf-8f56-65ef48332037 req-0c441504-8fa8-40b4-ab4f-6fe47ab9ee3c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042762 Aug 03 10:53:07.012147 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 502/1024] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:53:07.796334 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f10664e9-01ef-4b2b-9602-e214460eb823 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:07.799275 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f10664e9-01ef-4b2b-9602-e214460eb823 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:07.807198 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f10664e9-01ef-4b2b-9602-e214460eb823 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:07.807872 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f10664e9-01ef-4b2b-9602-e214460eb823 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:07.808875 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f10664e9-01ef-4b2b-9602-e214460eb823 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:07.810156 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f10664e9-01ef-4b2b-9602-e214460eb823 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:07.842459 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f10664e9-01ef-4b2b-9602-e214460eb823 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049948 Aug 03 10:53:07.843290 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 523/1025] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 3 10:53:07 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 10:53:07.857925 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d5680194-87cd-4d48-9a57-eb41413c3ff5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:07.858504 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d5680194-87cd-4d48-9a57-eb41413c3ff5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:07.865268 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d5680194-87cd-4d48-9a57-eb41413c3ff5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:07.866097 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d5680194-87cd-4d48-9a57-eb41413c3ff5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:07.867292 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d5680194-87cd-4d48-9a57-eb41413c3ff5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:07.868043 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d5680194-87cd-4d48-9a57-eb41413c3ff5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:07.967006 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-d5680194-87cd-4d48-9a57-eb41413c3ff5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] HTTP exception thrown: Instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 is not attached to volume 9b597270-e3a1-47f8-b003-bc7eaa3d4e3c Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d5680194-87cd-4d48-9a57-eb41413c3ff5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Request method failure captured: Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: DELETE /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/os-volume_attachments/9b597270-e3a1-47f8-b003-bc7eaa3d4e3c HTTP/1.1 Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lMEzNlEADdTaJ4OcT8KfIgUestAspTQcfN4WVJtrLpi8kCatHX2rx-XJ4LflhK7aAPZBl46lV-7WMpgnrwo02HszDMn-7eO8PG4E1Fu-K98D4zJE282dHHnNgcrDbXOl_c00MhZzE-FyxpJ_-ONB0zTGgQk7iMpKh5o8oMlRDVlNds Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: ac7eca525bbe4443a7b99e0aa921050e Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-TestMinimumBasicScenario-87501006 Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:53:07.979448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:53:07.981195 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac7eca525bbe4443a7b99e0aa921050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ac7eca525bbe4443a7b99e0aa921050e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac7eca525bbe4443a7b99e0aa921050e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ac7eca525bbe4443a7b99e0aa921050e", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:53:07.981195 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-TestMinimumBasicScenario-87501006 Aug 03 10:53:07.981195 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: ac7eca525bbe4443a7b99e0aa921050e Aug 03 10:53:07.981195 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-TestMinimumBasicScenario-87501006 Aug 03 10:53:07.981195 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-TestMinimumBasicScenario-87501006-project Aug 03 10:53:07.981195 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:53:07.981195 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:53:07.981195 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 538d552b04a8446094d2e84952804795 Aug 03 10:53:07.981195 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-TestMinimumBasicScenario-87501006-project Aug 03 10:53:07.981195 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:53:07.981195 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 is not attached to volume 9b597270-e3a1-47f8-b003-bc7eaa3d4e3c Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'server_id': '00a25924-4ed2-43e0-85ff-bc4b9ad88387', 'id': '9b597270-e3a1-47f8-b003-bc7eaa3d4e3c'} Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9b597270-e3a1-47f8-b003-bc7eaa3d4e3c. Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:53:07.982225 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:53:07.983699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:53:07.983699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 10:53:07.983699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 10:53:07.983699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 is not attached to volume 9b597270-e3a1-47f8-b003-bc7eaa3d4e3c Aug 03 10:53:07.983699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:53:07.983699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:53:07.983699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:53:07.983699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:53:07.983699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:53:07.983699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:53:07.983699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:53:07.983699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:53:07.983699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 is not attached to volume 9b597270-e3a1-47f8-b003-bc7eaa3d4e3c Aug 03 10:53:07.983699 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:53:07.985984 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d5680194-87cd-4d48-9a57-eb41413c3ff5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Returning 404 to user: Instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 is not attached to volume 9b597270-e3a1-47f8-b003-bc7eaa3d4e3c {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:53:07.987129 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d5680194-87cd-4d48-9a57-eb41413c3ff5 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "DELETE /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/os-volume_attachments/9b597270-e3a1-47f8-b003-bc7eaa3d4e3c" status: 404 len: 154 microversion: 2.1 time: 0.136197 Aug 03 10:53:07.987866 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 503/1026] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 3 10:53:07 2022] DELETE /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387/os-volume_attachments/9b597270-e3a1-47f8-b003-bc7eaa3d4e3c => generated 154 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:53:09.188524 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b915d3d3-2a60-4096-859a-05602a31ff5e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:09.189780 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b915d3d3-2a60-4096-859a-05602a31ff5e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:09.197267 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b915d3d3-2a60-4096-859a-05602a31ff5e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:09.197734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b915d3d3-2a60-4096-859a-05602a31ff5e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:09.198512 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b915d3d3-2a60-4096-859a-05602a31ff5e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:09.199110 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b915d3d3-2a60-4096-859a-05602a31ff5e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:09.226442 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b915d3d3-2a60-4096-859a-05602a31ff5e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:53:09.317603 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b915d3d3-2a60-4096-859a-05602a31ff5e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "DELETE /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 204 len: 0 microversion: 2.1 time: 0.133152 Aug 03 10:53:09.318841 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 524/1027] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:53:09 2022] DELETE /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:53:09.328572 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-d3677050-d7da-4cb3-afc7-5a354a718032 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:09.329182 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-d3677050-d7da-4cb3-afc7-5a354a718032 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:09.346941 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d3677050-d7da-4cb3-afc7-5a354a718032 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:09.347723 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d3677050-d7da-4cb3-afc7-5a354a718032 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:09.349153 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d3677050-d7da-4cb3-afc7-5a354a718032 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:09.349938 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-d3677050-d7da-4cb3-afc7-5a354a718032 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:09.520409 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-d3677050-d7da-4cb3-afc7-5a354a718032 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:53:09.529780 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-d3677050-d7da-4cb3-afc7-5a354a718032 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1554 microversion: 2.1 time: 0.204988 Aug 03 10:53:09.530493 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 504/1028] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:53:09 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1554 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:53:10.552655 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-196903b3-d037-487f-9bc2-e8625d4d0fe3 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:10.553356 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-196903b3-d037-487f-9bc2-e8625d4d0fe3 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:10.560482 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-196903b3-d037-487f-9bc2-e8625d4d0fe3 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:10.560925 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-196903b3-d037-487f-9bc2-e8625d4d0fe3 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:10.561815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-196903b3-d037-487f-9bc2-e8625d4d0fe3 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:10.562250 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-196903b3-d037-487f-9bc2-e8625d4d0fe3 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:10.694541 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-196903b3-d037-487f-9bc2-e8625d4d0fe3 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:53:10.702030 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-196903b3-d037-487f-9bc2-e8625d4d0fe3 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1554 microversion: 2.1 time: 0.153570 Aug 03 10:53:10.702581 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 525/1029] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:53:10 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:53:11.559731 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-041c202a-9e59-4bcf-ba22-363707a3eacc req-aeb41b9a-d778-4a6e-8978-f0abe4c50a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a25924-4ed2-43e0-85ff-bc4b9ad88387", "name": "network-vif-deleted", "tag": "9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:53:11.569943 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-041c202a-9e59-4bcf-ba22-363707a3eacc req-aeb41b9a-d778-4a6e-8978-f0abe4c50a80 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:11.570476 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-041c202a-9e59-4bcf-ba22-363707a3eacc req-aeb41b9a-d778-4a6e-8978-f0abe4c50a80 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:11.585546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-041c202a-9e59-4bcf-ba22-363707a3eacc req-aeb41b9a-d778-4a6e-8978-f0abe4c50a80 service nova] Creating event network-vif-deleted:9b4fdf6b-6ee1-43ff-a2d1-c44ab3ddfdff for instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 on hv-cinder-85083 Aug 03 10:53:11.591106 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-041c202a-9e59-4bcf-ba22-363707a3eacc req-aeb41b9a-d778-4a6e-8978-f0abe4c50a80 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036144 Aug 03 10:53:11.592066 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 505/1030] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:53:11.722793 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4a0dc937-2419-4451-af83-9fffd9e07059 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:11.723465 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4a0dc937-2419-4451-af83-9fffd9e07059 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:11.730295 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4a0dc937-2419-4451-af83-9fffd9e07059 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:11.730748 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4a0dc937-2419-4451-af83-9fffd9e07059 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:11.731530 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4a0dc937-2419-4451-af83-9fffd9e07059 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:11.731969 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4a0dc937-2419-4451-af83-9fffd9e07059 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:11.764939 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4a0dc937-2419-4451-af83-9fffd9e07059 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:11.765313 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4a0dc937-2419-4451-af83-9fffd9e07059 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:11.765807 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-4a0dc937-2419-4451-af83-9fffd9e07059 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lazy-loading 'fault' on Instance uuid 00a25924-4ed2-43e0-85ff-bc4b9ad88387 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:53:11.807108 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4a0dc937-2419-4451-af83-9fffd9e07059 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538d552b04a8446094d2e84952804795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7eca525bbe4443a7b99e0aa921050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:53:11.815005 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4a0dc937-2419-4451-af83-9fffd9e07059 tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 200 len: 1348 microversion: 2.1 time: 0.095920 Aug 03 10:53:11.815962 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 526/1031] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:53:11 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:53:12.838415 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-dbad4c65-b8e5-4f48-9384-8f05c304317e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:12.839037 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-dbad4c65-b8e5-4f48-9384-8f05c304317e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] [instance: 00a25924-4ed2-43e0-85ff-bc4b9ad88387] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:12.846242 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dbad4c65-b8e5-4f48-9384-8f05c304317e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:12.846774 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dbad4c65-b8e5-4f48-9384-8f05c304317e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:12.847480 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dbad4c65-b8e5-4f48-9384-8f05c304317e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:12.847916 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-dbad4c65-b8e5-4f48-9384-8f05c304317e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:12.866255 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-dbad4c65-b8e5-4f48-9384-8f05c304317e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] HTTP exception thrown: Instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 could not be found. Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-dbad4c65-b8e5-4f48-9384-8f05c304317e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Request method failure captured: Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 HTTP/1.1 Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lMEzNlEADdTaJ4OcT8KfIgUestAspTQcfN4WVJtrLpi8kCatHX2rx-XJ4LflhK7aAPZBl46lV-7WMpgnrwo02HszDMn-7eO8PG4E1Fu-K98D4zJE282dHHnNgcrDbXOl_c00MhZzE-FyxpJ_-ONB0zTGgQk7iMpKh5o8oMlRDVlNds Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: ac7eca525bbe4443a7b99e0aa921050e Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-TestMinimumBasicScenario-87501006 Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:53:12.868323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:53:12.871172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac7eca525bbe4443a7b99e0aa921050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ac7eca525bbe4443a7b99e0aa921050e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac7eca525bbe4443a7b99e0aa921050e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ac7eca525bbe4443a7b99e0aa921050e", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:53:12.871172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-TestMinimumBasicScenario-87501006 Aug 03 10:53:12.871172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: ac7eca525bbe4443a7b99e0aa921050e Aug 03 10:53:12.871172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-TestMinimumBasicScenario-87501006 Aug 03 10:53:12.871172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-TestMinimumBasicScenario-87501006-project Aug 03 10:53:12.871172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:53:12.871172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:53:12.871172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 538d552b04a8446094d2e84952804795 Aug 03 10:53:12.871172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-TestMinimumBasicScenario-87501006-project Aug 03 10:53:12.871172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:53:12.871172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 could not be found. Aug 03 10:53:12.871172 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '00a25924-4ed2-43e0-85ff-bc4b9ad88387'} Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 could not be found. Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:53:12.872030 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 could not be found. Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 could not be found. Aug 03 10:53:12.873350 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:53:12.874803 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-dbad4c65-b8e5-4f48-9384-8f05c304317e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Returning 404 to user: Instance 00a25924-4ed2-43e0-85ff-bc4b9ad88387 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:53:12.874803 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-dbad4c65-b8e5-4f48-9384-8f05c304317e tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387" status: 404 len: 111 microversion: 2.1 time: 0.037028 Aug 03 10:53:12.874803 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 506/1032] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:53:12 2022] GET /compute/v2.1/servers/00a25924-4ed2-43e0-85ff-bc4b9ad88387 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:53:12.879244 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-46efa039-eccb-4286-8608-2332cfcd786f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] Calling method '.version_select at 0x7fbd14f02700>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:12.905035 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-46efa039-eccb-4286-8608-2332cfcd786f tempest-TestMinimumBasicScenario-87501006 tempest-TestMinimumBasicScenario-87501006-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-716418589" status: 202 len: 0 microversion: 2.1 time: 0.029494 Aug 03 10:53:12.909322 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 527/1033] 10.222.0.47 () {58 vars in 1269 bytes} [Wed Aug 3 10:53:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-716418589 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:53:30.856676 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=14 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:53:30.857309 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:53:31.068742 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1139e2c3-4a1f-42e0-b0fb-dd64d68e22d6 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Action: 'create', calling method: .version_select at 0x7fbd106e83a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-25075408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBI+oSG2XVkmL9ijbKk3R6GhJF1DGf+QbNENtuARY/8piOZeQSEhZkfvcCHs8+kz/55tRm91TDazgNVJSANc69kx4YzB15p2hIyVJZ0H1RAqpWc9uYoeqB7O28kFPJrF6g=="}} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:53:31.085222 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-1139e2c3-4a1f-42e0-b0fb-dd64d68e22d6 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Getting quotas for project ad63d5a5bdb44dd6af0c25d524f38508. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:53:31.090087 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.quota [None req-1139e2c3-4a1f-42e0-b0fb-dd64d68e22d6 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Getting quotas for user 7445b3f8940244c2abe1e3f1573bcd8a and project ad63d5a5bdb44dd6af0c25d524f38508. Resources: {'key_pairs'} {{(pid=124389) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:53:31.122569 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1139e2c3-4a1f-42e0-b0fb-dd64d68e22d6 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.271468 Aug 03 10:53:31.123044 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 507/1034] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 3 10:53:30 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:53:46.370326 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:53:46.371079 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:53:46.375482 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-726671745", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-25075408", "security_groups": [{"name": "tempest-secgroup-smoke-1904408597"}], "block_device_mapping_v2": [{"uuid": "b6c263d5-208e-40a5-9f5b-f0d85722a5fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6488fdc6-3ef0-410f-ba70-1b6189bea96e"}]}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:53:46.588247 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] validate_networks() for [('6488fdc6-3ef0-410f-ba70-1b6189bea96e', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:53:46.955628 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:53:46.956079 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:53:46.956581 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:53:46.957067 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:53:46.957515 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:53:46.967558 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:46.967996 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:46.968785 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:46.969214 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:46.985587 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Getting quotas for project ad63d5a5bdb44dd6af0c25d524f38508. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:53:46.989665 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Getting quotas for user 7445b3f8940244c2abe1e3f1573bcd8a and project ad63d5a5bdb44dd6af0c25d524f38508. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:53:47.046082 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:53:47.048189 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b6c263d5-208e-40a5-9f5b-f0d85722a5fa',volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:53:47.180022 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9e1a2d7b-833f-40eb-b3ff-5462bcfc4406 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.811308 Aug 03 10:53:47.181234 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 528/1035] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:53:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:53:47.190190 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=4 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:53:47.191513 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:53:47.196769 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-f828751a-f55e-436d-87ff-62293443212c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:47.197405 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-f828751a-f55e-436d-87ff-62293443212c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:47.376454 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-f828751a-f55e-436d-87ff-62293443212c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:53:47.383577 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-f828751a-f55e-436d-87ff-62293443212c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1092 microversion: 2.1 time: 0.195159 Aug 03 10:53:47.396902 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 508/1036] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:53:47 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1092 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:53:48.404791 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cecd50e0-a9a1-4298-b790-53be4d03da5c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:48.406272 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-cecd50e0-a9a1-4298-b790-53be4d03da5c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:48.415486 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cecd50e0-a9a1-4298-b790-53be4d03da5c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:48.416345 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cecd50e0-a9a1-4298-b790-53be4d03da5c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:48.417896 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cecd50e0-a9a1-4298-b790-53be4d03da5c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:48.418343 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cecd50e0-a9a1-4298-b790-53be4d03da5c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:48.484375 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-cecd50e0-a9a1-4298-b790-53be4d03da5c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:53:48.492308 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-cecd50e0-a9a1-4298-b790-53be4d03da5c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1208 microversion: 2.1 time: 0.091986 Aug 03 10:53:48.493283 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 529/1037] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:53:48 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1208 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:53:49.515007 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-eeea5243-78ce-4662-8a0b-99fd0acb8ee4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:49.515622 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-eeea5243-78ce-4662-8a0b-99fd0acb8ee4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:49.522410 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-eeea5243-78ce-4662-8a0b-99fd0acb8ee4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:49.522860 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-eeea5243-78ce-4662-8a0b-99fd0acb8ee4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:49.523627 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-eeea5243-78ce-4662-8a0b-99fd0acb8ee4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:49.524055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-eeea5243-78ce-4662-8a0b-99fd0acb8ee4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:49.591576 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-f028c734-6edf-46a5-9ac2-cf1648627dfd req-72a0be85-fd68-4d2a-8f01-a55a82febdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7080ee4-892a-4b29-99cf-2b3907ed9b9d", "tag": "2fedd759-09ae-4ddd-b37d-869f235cb8ef"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:53:49.603943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-f028c734-6edf-46a5-9ac2-cf1648627dfd req-72a0be85-fd68-4d2a-8f01-a55a82febdf2 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:49.605403 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-f028c734-6edf-46a5-9ac2-cf1648627dfd req-72a0be85-fd68-4d2a-8f01-a55a82febdf2 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:49.629552 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-f028c734-6edf-46a5-9ac2-cf1648627dfd req-72a0be85-fd68-4d2a-8f01-a55a82febdf2 service nova] Creating event network-changed:2fedd759-09ae-4ddd-b37d-869f235cb8ef for instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d on hv-cinder-85083 Aug 03 10:53:49.636215 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-f028c734-6edf-46a5-9ac2-cf1648627dfd req-72a0be85-fd68-4d2a-8f01-a55a82febdf2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051013 Aug 03 10:53:49.637236 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 530/1038] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:53:49.674611 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-eeea5243-78ce-4662-8a0b-99fd0acb8ee4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:53:49.683750 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-eeea5243-78ce-4662-8a0b-99fd0acb8ee4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1264 microversion: 2.1 time: 0.173273 Aug 03 10:53:49.684700 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 509/1039] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:53:49 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:53:50.706079 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-32c4a752-7141-4326-800b-5db628a4f490 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:50.706677 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-32c4a752-7141-4326-800b-5db628a4f490 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:50.713628 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-32c4a752-7141-4326-800b-5db628a4f490 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:50.714091 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-32c4a752-7141-4326-800b-5db628a4f490 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:50.714878 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-32c4a752-7141-4326-800b-5db628a4f490 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:50.715317 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-32c4a752-7141-4326-800b-5db628a4f490 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:50.998250 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-32c4a752-7141-4326-800b-5db628a4f490 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:53:51.005676 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-32c4a752-7141-4326-800b-5db628a4f490 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1264 microversion: 2.1 time: 0.304589 Aug 03 10:53:51.006233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 531/1040] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:53:50 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1264 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:53:52.026378 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9c314043-a4d6-491f-9de9-aa191c1267c3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:52.026960 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9c314043-a4d6-491f-9de9-aa191c1267c3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:52.033504 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9c314043-a4d6-491f-9de9-aa191c1267c3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:52.033950 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9c314043-a4d6-491f-9de9-aa191c1267c3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:52.034713 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9c314043-a4d6-491f-9de9-aa191c1267c3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:52.035138 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9c314043-a4d6-491f-9de9-aa191c1267c3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:52.171863 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9c314043-a4d6-491f-9de9-aa191c1267c3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:53:52.179454 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9c314043-a4d6-491f-9de9-aa191c1267c3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1264 microversion: 2.1 time: 0.157397 Aug 03 10:53:52.180024 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 510/1041] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:53:52 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:53:53.200186 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-61bff215-3ff6-4b74-970f-b5050df31bdd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:53.200794 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-61bff215-3ff6-4b74-970f-b5050df31bdd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:53.207367 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-61bff215-3ff6-4b74-970f-b5050df31bdd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:53.207817 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-61bff215-3ff6-4b74-970f-b5050df31bdd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:53.208579 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-61bff215-3ff6-4b74-970f-b5050df31bdd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:53.209015 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-61bff215-3ff6-4b74-970f-b5050df31bdd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:53.340764 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-61bff215-3ff6-4b74-970f-b5050df31bdd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:53:53.348188 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-61bff215-3ff6-4b74-970f-b5050df31bdd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1264 microversion: 2.1 time: 0.152083 Aug 03 10:53:53.348751 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 532/1042] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:53:53 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:53:54.370255 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5a5424ba-2a0a-4741-9857-af59752b8bf7 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:54.370862 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-5a5424ba-2a0a-4741-9857-af59752b8bf7 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:54.378087 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5a5424ba-2a0a-4741-9857-af59752b8bf7 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:54.378529 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5a5424ba-2a0a-4741-9857-af59752b8bf7 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:54.379298 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5a5424ba-2a0a-4741-9857-af59752b8bf7 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:54.379724 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5a5424ba-2a0a-4741-9857-af59752b8bf7 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:54.509707 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5a5424ba-2a0a-4741-9857-af59752b8bf7 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:53:54.517644 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5a5424ba-2a0a-4741-9857-af59752b8bf7 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1264 microversion: 2.1 time: 0.152077 Aug 03 10:53:54.518199 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 511/1043] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:53:54 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:53:55.538591 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9e601dbc-887e-4b5f-aff9-6f176a2a7cb0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:55.539233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9e601dbc-887e-4b5f-aff9-6f176a2a7cb0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:55.545841 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9e601dbc-887e-4b5f-aff9-6f176a2a7cb0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:55.546295 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9e601dbc-887e-4b5f-aff9-6f176a2a7cb0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:55.547068 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9e601dbc-887e-4b5f-aff9-6f176a2a7cb0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:55.547509 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9e601dbc-887e-4b5f-aff9-6f176a2a7cb0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:55.680014 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9e601dbc-887e-4b5f-aff9-6f176a2a7cb0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:53:55.688490 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9e601dbc-887e-4b5f-aff9-6f176a2a7cb0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1264 microversion: 2.1 time: 0.153757 Aug 03 10:53:55.689049 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 533/1044] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:53:55 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:53:56.710435 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e8c2f9cb-6fbb-4c89-ad9f-c6da937b401e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:56.711048 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e8c2f9cb-6fbb-4c89-ad9f-c6da937b401e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:56.718171 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e8c2f9cb-6fbb-4c89-ad9f-c6da937b401e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:56.718666 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e8c2f9cb-6fbb-4c89-ad9f-c6da937b401e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:56.719419 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e8c2f9cb-6fbb-4c89-ad9f-c6da937b401e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:56.719847 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e8c2f9cb-6fbb-4c89-ad9f-c6da937b401e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:56.851228 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e8c2f9cb-6fbb-4c89-ad9f-c6da937b401e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:53:56.858654 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e8c2f9cb-6fbb-4c89-ad9f-c6da937b401e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1264 microversion: 2.1 time: 0.152445 Aug 03 10:53:56.859260 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 512/1045] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:53:56 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:53:57.879559 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2bd97bc5-ae81-4275-9cfc-9d15827d1283 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:57.880199 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2bd97bc5-ae81-4275-9cfc-9d15827d1283 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:57.882707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:53:57.883369 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=6 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:53:57.889115 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2bd97bc5-ae81-4275-9cfc-9d15827d1283 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:57.889596 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2bd97bc5-ae81-4275-9cfc-9d15827d1283 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:57.890365 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2bd97bc5-ae81-4275-9cfc-9d15827d1283 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:57.890833 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2bd97bc5-ae81-4275-9cfc-9d15827d1283 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:58.020877 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2bd97bc5-ae81-4275-9cfc-9d15827d1283 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:53:58.029054 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2bd97bc5-ae81-4275-9cfc-9d15827d1283 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1264 microversion: 2.1 time: 0.153391 Aug 03 10:53:58.029650 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 534/1046] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:53:57 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:53:59.050414 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-79451de7-916f-4f7b-b78e-cd4367888843 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:53:59.051057 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-79451de7-916f-4f7b-b78e-cd4367888843 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:53:59.052938 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:53:59.059674 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-79451de7-916f-4f7b-b78e-cd4367888843 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:59.060123 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-79451de7-916f-4f7b-b78e-cd4367888843 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:59.060900 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-79451de7-916f-4f7b-b78e-cd4367888843 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:59.061337 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-79451de7-916f-4f7b-b78e-cd4367888843 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:59.436890 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-79451de7-916f-4f7b-b78e-cd4367888843 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:53:59.444333 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-79451de7-916f-4f7b-b78e-cd4367888843 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1264 microversion: 2.1 time: 0.397796 Aug 03 10:53:59.444896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 513/1047] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:53:59 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1264 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:53:59.734725 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-7a2c5c11-e275-4494-9536-53838d88e291 req-eec89674-a8d4-44f7-83e6-88bda0679f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7080ee4-892a-4b29-99cf-2b3907ed9b9d", "name": "network-vif-plugged", "status": "completed", "tag": "2fedd759-09ae-4ddd-b37d-869f235cb8ef"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:53:59.746275 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-7a2c5c11-e275-4494-9536-53838d88e291 req-eec89674-a8d4-44f7-83e6-88bda0679f57 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:53:59.746728 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-7a2c5c11-e275-4494-9536-53838d88e291 req-eec89674-a8d4-44f7-83e6-88bda0679f57 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:53:59.758202 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-7a2c5c11-e275-4494-9536-53838d88e291 req-eec89674-a8d4-44f7-83e6-88bda0679f57 service nova] Creating event network-vif-plugged:2fedd759-09ae-4ddd-b37d-869f235cb8ef for instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d on hv-cinder-85083 Aug 03 10:53:59.763808 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-7a2c5c11-e275-4494-9536-53838d88e291 req-eec89674-a8d4-44f7-83e6-88bda0679f57 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033427 Aug 03 10:53:59.764397 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 535/1048] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:54:00.464156 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5e1dc1f0-2273-4d7f-afc2-38ea05bd974c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:54:00.464787 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-5e1dc1f0-2273-4d7f-afc2-38ea05bd974c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:54:00.471703 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5e1dc1f0-2273-4d7f-afc2-38ea05bd974c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:54:00.472156 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5e1dc1f0-2273-4d7f-afc2-38ea05bd974c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:54:00.472922 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5e1dc1f0-2273-4d7f-afc2-38ea05bd974c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:54:00.473356 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5e1dc1f0-2273-4d7f-afc2-38ea05bd974c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:54:00.604417 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5e1dc1f0-2273-4d7f-afc2-38ea05bd974c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:54:00.612283 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5e1dc1f0-2273-4d7f-afc2-38ea05bd974c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1264 microversion: 2.1 time: 0.151987 Aug 03 10:54:00.612911 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 514/1049] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:54:00 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:54:01.634396 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a9a2178c-b1b9-46e0-8220-12f5567a11a9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:54:01.635102 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a9a2178c-b1b9-46e0-8220-12f5567a11a9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:54:01.642559 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a9a2178c-b1b9-46e0-8220-12f5567a11a9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:54:01.643003 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a9a2178c-b1b9-46e0-8220-12f5567a11a9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:54:01.644233 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a9a2178c-b1b9-46e0-8220-12f5567a11a9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:54:01.644650 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a9a2178c-b1b9-46e0-8220-12f5567a11a9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:54:01.776715 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a9a2178c-b1b9-46e0-8220-12f5567a11a9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:54:01.784202 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a9a2178c-b1b9-46e0-8220-12f5567a11a9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1450 microversion: 2.1 time: 0.154028 Aug 03 10:54:01.784748 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 536/1050] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:54:01 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:54:01.803863 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-a4077a8f-fa0b-42dd-9153-2cd6268e8d30 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:54:01.804476 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-a4077a8f-fa0b-42dd-9153-2cd6268e8d30 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:54:01.811373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a4077a8f-fa0b-42dd-9153-2cd6268e8d30 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:54:01.811816 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a4077a8f-fa0b-42dd-9153-2cd6268e8d30 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:54:01.812573 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a4077a8f-fa0b-42dd-9153-2cd6268e8d30 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:54:01.813003 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-a4077a8f-fa0b-42dd-9153-2cd6268e8d30 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:54:01.942037 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-a4077a8f-fa0b-42dd-9153-2cd6268e8d30 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:54:01.950381 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-a4077a8f-fa0b-42dd-9153-2cd6268e8d30 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1450 microversion: 2.1 time: 0.150290 Aug 03 10:54:01.950939 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 515/1051] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:54:01 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:54:03.556818 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-65c68eb7-5f42-4c7c-8a61-5717cd42bfeb req-c4cf36fe-3fd0-42a1-b699-66f012400e18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7080ee4-892a-4b29-99cf-2b3907ed9b9d", "tag": "2fedd759-09ae-4ddd-b37d-869f235cb8ef"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:54:03.566640 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-65c68eb7-5f42-4c7c-8a61-5717cd42bfeb req-c4cf36fe-3fd0-42a1-b699-66f012400e18 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:54:03.567080 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-65c68eb7-5f42-4c7c-8a61-5717cd42bfeb req-c4cf36fe-3fd0-42a1-b699-66f012400e18 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:54:03.578986 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-65c68eb7-5f42-4c7c-8a61-5717cd42bfeb req-c4cf36fe-3fd0-42a1-b699-66f012400e18 service nova] Creating event network-changed:2fedd759-09ae-4ddd-b37d-869f235cb8ef for instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d on hv-cinder-85083 Aug 03 10:54:03.584378 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-65c68eb7-5f42-4c7c-8a61-5717cd42bfeb req-c4cf36fe-3fd0-42a1-b699-66f012400e18 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031174 Aug 03 10:54:03.584976 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 537/1052] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:55:46.572477 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:55:46.573128 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Wed Aug 3 10:55:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:55:58.862555 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6cd9f5c-14cd-4cb8-a6b8-5c4b281e5dc6] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 10:55:58.863238 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=18 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:55:58.864012 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=42 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:55:58.868490 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-158baa47-a5aa-4662-80c1-2eca4265e8da tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:55:58.868988 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-158baa47-a5aa-4662-80c1-2eca4265e8da tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:55:58.875881 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-158baa47-a5aa-4662-80c1-2eca4265e8da tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:55:58.876323 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-158baa47-a5aa-4662-80c1-2eca4265e8da tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:55:58.877094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-158baa47-a5aa-4662-80c1-2eca4265e8da tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:55:58.877555 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-158baa47-a5aa-4662-80c1-2eca4265e8da tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:55:58.904516 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-158baa47-a5aa-4662-80c1-2eca4265e8da tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Going to try to terminate instance {{(pid=124389) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:55:58.961535 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR oslo.messaging._drivers.impl_rabbit [None req-158baa47-a5aa-4662-80c1-2eca4265e8da tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [a5ab7ef8-c59e-4f41-8650-46d146309aa8] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 10:55:59.871387 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6cd9f5c-14cd-4cb8-a6b8-5c4b281e5dc6] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 43014. Aug 03 10:55:59.967770 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO oslo.messaging._drivers.impl_rabbit [None req-158baa47-a5aa-4662-80c1-2eca4265e8da tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [a5ab7ef8-c59e-4f41-8650-46d146309aa8] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 43016. Aug 03 10:55:59.988120 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-158baa47-a5aa-4662-80c1-2eca4265e8da tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 204 len: 0 microversion: 2.1 time: 1.127408 Aug 03 10:55:59.988770 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 516/1053] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:55:58 2022] DELETE /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 0 bytes in 1129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:55:59.996393 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec406222-3aa9-4ffb-b6aa-5b1a65cc6002] AMQP server on 10.222.0.47:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 03 10:55:59.997044 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:55:59.997893 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=44 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:56:00.002539 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a237c156-c927-497f-a60c-c91d6c740382 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:00.003243 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a237c156-c927-497f-a60c-c91d6c740382 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:00.011035 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a237c156-c927-497f-a60c-c91d6c740382 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:00.011493 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a237c156-c927-497f-a60c-c91d6c740382 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:00.012293 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a237c156-c927-497f-a60c-c91d6c740382 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:00.012727 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a237c156-c927-497f-a60c-c91d6c740382 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:00.151455 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a237c156-c927-497f-a60c-c91d6c740382 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:00.158960 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a237c156-c927-497f-a60c-c91d6c740382 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1574 microversion: 2.1 time: 0.164811 Aug 03 10:56:00.159516 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 538/1054] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:55:59 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:01.181719 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9410282d-1ab1-4e3e-980b-9e9ed70f2a85 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:01.182413 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9410282d-1ab1-4e3e-980b-9e9ed70f2a85 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:01.190114 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9410282d-1ab1-4e3e-980b-9e9ed70f2a85 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:01.190709 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9410282d-1ab1-4e3e-980b-9e9ed70f2a85 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:01.191483 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9410282d-1ab1-4e3e-980b-9e9ed70f2a85 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:01.191909 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9410282d-1ab1-4e3e-980b-9e9ed70f2a85 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:01.340606 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9410282d-1ab1-4e3e-980b-9e9ed70f2a85 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:01.349103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9410282d-1ab1-4e3e-980b-9e9ed70f2a85 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1574 microversion: 2.1 time: 0.172279 Aug 03 10:56:01.349811 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 517/1055] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:01 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:02.363848 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec406222-3aa9-4ffb-b6aa-5b1a65cc6002] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 43030. Aug 03 10:56:02.372335 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-94ca11bc-b2db-4ba2-a5aa-a7df6633992c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:02.373928 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-94ca11bc-b2db-4ba2-a5aa-a7df6633992c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:02.389151 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-94ca11bc-b2db-4ba2-a5aa-a7df6633992c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:02.389878 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-94ca11bc-b2db-4ba2-a5aa-a7df6633992c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:02.391471 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-94ca11bc-b2db-4ba2-a5aa-a7df6633992c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:02.391909 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-94ca11bc-b2db-4ba2-a5aa-a7df6633992c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:02.468277 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-aed61a6b-7258-4adb-a7f7-593587c5b93f req-f02c770b-4165-457d-84b9-da521b31f46c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7080ee4-892a-4b29-99cf-2b3907ed9b9d", "name": "network-vif-deleted", "tag": "2fedd759-09ae-4ddd-b37d-869f235cb8ef"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:56:02.481431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-aed61a6b-7258-4adb-a7f7-593587c5b93f req-f02c770b-4165-457d-84b9-da521b31f46c service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:02.481904 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-aed61a6b-7258-4adb-a7f7-593587c5b93f req-f02c770b-4165-457d-84b9-da521b31f46c service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:02.508664 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-aed61a6b-7258-4adb-a7f7-593587c5b93f req-f02c770b-4165-457d-84b9-da521b31f46c service nova] Creating event network-vif-deleted:2fedd759-09ae-4ddd-b37d-869f235cb8ef for instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d on hv-cinder-85083 Aug 03 10:56:02.512500 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-94ca11bc-b2db-4ba2-a5aa-a7df6633992c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:02.520432 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-aed61a6b-7258-4adb-a7f7-593587c5b93f req-f02c770b-4165-457d-84b9-da521b31f46c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172312 Aug 03 10:56:02.521986 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-94ca11bc-b2db-4ba2-a5aa-a7df6633992c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 200 len: 1223 microversion: 2.1 time: 0.153340 Aug 03 10:56:02.523085 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 518/1056] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:02 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 1223 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:02.526721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 539/1057] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:56:03.543492 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-fb0d041e-bd2d-4f79-ba6a-c650c4783bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:03.544288 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-fb0d041e-bd2d-4f79-ba6a-c650c4783bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:03.552766 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fb0d041e-bd2d-4f79-ba6a-c650c4783bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:03.553851 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fb0d041e-bd2d-4f79-ba6a-c650c4783bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:03.554948 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fb0d041e-bd2d-4f79-ba6a-c650c4783bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:03.555388 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-fb0d041e-bd2d-4f79-ba6a-c650c4783bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:03.570961 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-fb0d041e-bd2d-4f79-ba6a-c650c4783bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] HTTP exception thrown: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-fb0d041e-bd2d-4f79-ba6a-c650c4783bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Request method failure captured: Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d HTTP/1.1 Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lOl5B4Usw5JETIYdtv4p8aPgT50_IJLXd2xMOr8uy3nOD6UkzFyNg3zLQOndleUv4_hngbNTnAl-ygbb_CiJ8_5-XjCQPKKSVAnx6KzuJ76ZrxcnvCpY8WqpO87fmByppgL32Unr65npMfqaaHErUWNpopXmV6BxT1deifMFJR8Oz8 Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: ad63d5a5bdb44dd6af0c25d524f38508 Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-TestVolumeBootPattern-1712361144 Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:56:03.572110 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:56:03.573843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad63d5a5bdb44dd6af0c25d524f38508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ad63d5a5bdb44dd6af0c25d524f38508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad63d5a5bdb44dd6af0c25d524f38508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ad63d5a5bdb44dd6af0c25d524f38508", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:56:03.573843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-TestVolumeBootPattern-1712361144 Aug 03 10:56:03.573843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: ad63d5a5bdb44dd6af0c25d524f38508 Aug 03 10:56:03.573843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-TestVolumeBootPattern-1712361144 Aug 03 10:56:03.573843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-TestVolumeBootPattern-1712361144-project Aug 03 10:56:03.573843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:56:03.573843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:56:03.573843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 7445b3f8940244c2abe1e3f1573bcd8a Aug 03 10:56:03.573843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-TestVolumeBootPattern-1712361144-project Aug 03 10:56:03.573843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:56:03.573843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. Aug 03 10:56:03.573843 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': 'b7080ee4-892a-4b29-99cf-2b3907ed9b9d'} Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:56:03.575487 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. Aug 03 10:56:03.577065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:56:03.578560 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-fb0d041e-bd2d-4f79-ba6a-c650c4783bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Returning 404 to user: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:56:03.578560 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-fb0d041e-bd2d-4f79-ba6a-c650c4783bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 404 len: 111 microversion: 2.1 time: 0.034051 Aug 03 10:56:03.578560 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 519/1058] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:03 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:56:03.629786 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-808085656", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-25075408", "security_groups": [{"name": "tempest-secgroup-smoke-1904408597"}], "block_device_mapping_v2": [{"uuid": "b6c263d5-208e-40a5-9f5b-f0d85722a5fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6488fdc6-3ef0-410f-ba70-1b6189bea96e"}]}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:56:03.750433 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] validate_networks() for [('6488fdc6-3ef0-410f-ba70-1b6189bea96e', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:56:04.137671 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:56:04.138106 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:56:04.138611 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:56:04.139018 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:56:04.139428 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:56:04.149431 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:04.149906 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:04.150698 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:04.151124 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:04.168007 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Getting quotas for project ad63d5a5bdb44dd6af0c25d524f38508. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:56:04.172503 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Getting quotas for user 7445b3f8940244c2abe1e3f1573bcd8a and project ad63d5a5bdb44dd6af0c25d524f38508. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:56:04.233134 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:56:04.235392 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b6c263d5-208e-40a5-9f5b-f0d85722a5fa',volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:56:04.373032 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f514b6b7-1d19-4041-8748-8fb30f773217 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751817 Aug 03 10:56:04.373707 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 540/1059] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:56:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:56:04.385786 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9ff5c600-380b-4aa2-bfeb-768cfe7c7347 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:04.386218 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9ff5c600-380b-4aa2-bfeb-768cfe7c7347 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:04.443480 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9ff5c600-380b-4aa2-bfeb-768cfe7c7347 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:04.451147 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9ff5c600-380b-4aa2-bfeb-768cfe7c7347 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1092 microversion: 2.1 time: 0.070297 Aug 03 10:56:04.451830 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 520/1060] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:04 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1092 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:05.472237 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b50cd49f-82a2-4ed1-ad5f-f5a9f2b095cf tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:05.473739 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b50cd49f-82a2-4ed1-ad5f-f5a9f2b095cf tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:05.482025 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b50cd49f-82a2-4ed1-ad5f-f5a9f2b095cf tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:05.482406 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b50cd49f-82a2-4ed1-ad5f-f5a9f2b095cf tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:05.483282 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b50cd49f-82a2-4ed1-ad5f-f5a9f2b095cf tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:05.483662 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b50cd49f-82a2-4ed1-ad5f-f5a9f2b095cf tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:05.558377 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b50cd49f-82a2-4ed1-ad5f-f5a9f2b095cf tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:05.566445 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b50cd49f-82a2-4ed1-ad5f-f5a9f2b095cf tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1208 microversion: 2.1 time: 0.098126 Aug 03 10:56:05.567136 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 541/1061] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:05 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1208 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:06.590460 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5c8158af-270d-4795-bd04-5abc36a97f83 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:06.591549 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-5c8158af-270d-4795-bd04-5abc36a97f83 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:06.601624 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5c8158af-270d-4795-bd04-5abc36a97f83 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:06.602136 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5c8158af-270d-4795-bd04-5abc36a97f83 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:06.602997 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5c8158af-270d-4795-bd04-5abc36a97f83 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:06.603502 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5c8158af-270d-4795-bd04-5abc36a97f83 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:06.755055 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5c8158af-270d-4795-bd04-5abc36a97f83 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:06.765387 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5c8158af-270d-4795-bd04-5abc36a97f83 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1264 microversion: 2.1 time: 0.180247 Aug 03 10:56:06.766425 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 521/1062] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:06 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:06.821971 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-8079893c-949c-44bd-a630-65bea8821d7d req-340dc5e0-d09d-449e-b464-ee3c7c2eabb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ff25cf-fceb-4cf3-b346-e7c9292e92a9", "tag": "5482f360-19f2-4834-97b3-e0b92e4ad931"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:56:06.836467 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-8079893c-949c-44bd-a630-65bea8821d7d req-340dc5e0-d09d-449e-b464-ee3c7c2eabb6 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:06.837246 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-8079893c-949c-44bd-a630-65bea8821d7d req-340dc5e0-d09d-449e-b464-ee3c7c2eabb6 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:06.853572 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-8079893c-949c-44bd-a630-65bea8821d7d req-340dc5e0-d09d-449e-b464-ee3c7c2eabb6 service nova] Creating event network-changed:5482f360-19f2-4834-97b3-e0b92e4ad931 for instance 89ff25cf-fceb-4cf3-b346-e7c9292e92a9 on hv-cinder-85083 Aug 03 10:56:06.860432 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-8079893c-949c-44bd-a630-65bea8821d7d req-340dc5e0-d09d-449e-b464-ee3c7c2eabb6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042803 Aug 03 10:56:06.861904 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 542/1063] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:56:07.788188 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-c7f0c468-6374-4d9b-90e9-ed487b7e1db8 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:07.788819 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-c7f0c468-6374-4d9b-90e9-ed487b7e1db8 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:07.796686 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c7f0c468-6374-4d9b-90e9-ed487b7e1db8 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:07.797184 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c7f0c468-6374-4d9b-90e9-ed487b7e1db8 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:07.798006 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c7f0c468-6374-4d9b-90e9-ed487b7e1db8 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:07.798445 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-c7f0c468-6374-4d9b-90e9-ed487b7e1db8 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:07.940673 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-c7f0c468-6374-4d9b-90e9-ed487b7e1db8 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:07.949262 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-c7f0c468-6374-4d9b-90e9-ed487b7e1db8 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1264 microversion: 2.1 time: 0.165266 Aug 03 10:56:07.949876 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 522/1064] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:07 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:08.971175 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c1fb3776-c101-4f51-bece-8657a869bc47 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:08.971871 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c1fb3776-c101-4f51-bece-8657a869bc47 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:08.979285 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c1fb3776-c101-4f51-bece-8657a869bc47 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:08.979734 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c1fb3776-c101-4f51-bece-8657a869bc47 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:08.980519 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c1fb3776-c101-4f51-bece-8657a869bc47 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:08.980957 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c1fb3776-c101-4f51-bece-8657a869bc47 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:09.112086 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c1fb3776-c101-4f51-bece-8657a869bc47 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:09.119822 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c1fb3776-c101-4f51-bece-8657a869bc47 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1264 microversion: 2.1 time: 0.152824 Aug 03 10:56:09.120381 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 543/1065] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:08 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:10.140456 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-6e0737c4-757e-4c11-a39f-fbdf6da9bb95 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:10.141065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-6e0737c4-757e-4c11-a39f-fbdf6da9bb95 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:10.147787 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e0737c4-757e-4c11-a39f-fbdf6da9bb95 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:10.148231 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e0737c4-757e-4c11-a39f-fbdf6da9bb95 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:10.149028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e0737c4-757e-4c11-a39f-fbdf6da9bb95 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:10.149492 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-6e0737c4-757e-4c11-a39f-fbdf6da9bb95 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:10.289402 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-6e0737c4-757e-4c11-a39f-fbdf6da9bb95 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:10.296897 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-6e0737c4-757e-4c11-a39f-fbdf6da9bb95 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1264 microversion: 2.1 time: 0.160345 Aug 03 10:56:10.297449 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 523/1066] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:10 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:11.319182 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d08576e2-ae5e-41e4-a86a-8b2b48f699cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:11.319795 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d08576e2-ae5e-41e4-a86a-8b2b48f699cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:11.326491 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d08576e2-ae5e-41e4-a86a-8b2b48f699cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:11.326943 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d08576e2-ae5e-41e4-a86a-8b2b48f699cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:11.327723 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d08576e2-ae5e-41e4-a86a-8b2b48f699cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:11.328158 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d08576e2-ae5e-41e4-a86a-8b2b48f699cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:11.462745 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d08576e2-ae5e-41e4-a86a-8b2b48f699cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:11.470163 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d08576e2-ae5e-41e4-a86a-8b2b48f699cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1264 microversion: 2.1 time: 0.155562 Aug 03 10:56:11.470720 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 544/1067] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:11 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:12.491184 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-b7056245-44bb-40d3-af6a-d32210a6c87b tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:12.491821 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-b7056245-44bb-40d3-af6a-d32210a6c87b tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:12.498647 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b7056245-44bb-40d3-af6a-d32210a6c87b tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:12.499094 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b7056245-44bb-40d3-af6a-d32210a6c87b tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:12.499979 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b7056245-44bb-40d3-af6a-d32210a6c87b tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:12.500413 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-b7056245-44bb-40d3-af6a-d32210a6c87b tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:12.634144 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-b7056245-44bb-40d3-af6a-d32210a6c87b tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:12.641737 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-b7056245-44bb-40d3-af6a-d32210a6c87b tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1264 microversion: 2.1 time: 0.154597 Aug 03 10:56:12.642304 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 524/1068] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:12 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:13.661662 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-669e1a39-dadd-4f33-8368-5f4cf9b021d3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:13.662987 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-669e1a39-dadd-4f33-8368-5f4cf9b021d3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:13.669849 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-669e1a39-dadd-4f33-8368-5f4cf9b021d3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:13.670308 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-669e1a39-dadd-4f33-8368-5f4cf9b021d3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:13.671097 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-669e1a39-dadd-4f33-8368-5f4cf9b021d3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:13.671535 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-669e1a39-dadd-4f33-8368-5f4cf9b021d3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:13.809904 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-669e1a39-dadd-4f33-8368-5f4cf9b021d3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:13.817432 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-669e1a39-dadd-4f33-8368-5f4cf9b021d3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1264 microversion: 2.1 time: 0.159764 Aug 03 10:56:13.818016 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 545/1069] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:13 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:14.838543 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2e85f7ff-2ebd-4a47-b59f-81376407d91a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:14.839329 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2e85f7ff-2ebd-4a47-b59f-81376407d91a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:14.842081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:56:14.848378 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2e85f7ff-2ebd-4a47-b59f-81376407d91a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:14.848825 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2e85f7ff-2ebd-4a47-b59f-81376407d91a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:14.849665 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2e85f7ff-2ebd-4a47-b59f-81376407d91a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:14.850098 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2e85f7ff-2ebd-4a47-b59f-81376407d91a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:14.996510 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-2e85f7ff-2ebd-4a47-b59f-81376407d91a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:15.004287 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2e85f7ff-2ebd-4a47-b59f-81376407d91a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1264 microversion: 2.1 time: 0.169818 Aug 03 10:56:15.005004 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 525/1070] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:14 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:16.025770 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5a6b2adb-324e-4382-8514-d487eeb69006 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:16.026355 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5a6b2adb-324e-4382-8514-d487eeb69006 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:16.028325 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:56:16.028981 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=6 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:56:16.035825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5a6b2adb-324e-4382-8514-d487eeb69006 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:16.036264 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5a6b2adb-324e-4382-8514-d487eeb69006 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:16.037564 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5a6b2adb-324e-4382-8514-d487eeb69006 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:16.037997 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5a6b2adb-324e-4382-8514-d487eeb69006 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:16.180546 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5a6b2adb-324e-4382-8514-d487eeb69006 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:16.188196 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5a6b2adb-324e-4382-8514-d487eeb69006 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1264 microversion: 2.1 time: 0.166251 Aug 03 10:56:16.188783 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 546/1071] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:16 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:16.360933 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-d44dfccc-ee2f-4532-89c7-4e32bc582f8b req-03985a51-1c27-42e8-80c2-01092e69658f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ff25cf-fceb-4cf3-b346-e7c9292e92a9", "name": "network-vif-plugged", "status": "completed", "tag": "5482f360-19f2-4834-97b3-e0b92e4ad931"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:56:16.372559 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-d44dfccc-ee2f-4532-89c7-4e32bc582f8b req-03985a51-1c27-42e8-80c2-01092e69658f service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:16.373010 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-d44dfccc-ee2f-4532-89c7-4e32bc582f8b req-03985a51-1c27-42e8-80c2-01092e69658f service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:16.384567 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-d44dfccc-ee2f-4532-89c7-4e32bc582f8b req-03985a51-1c27-42e8-80c2-01092e69658f service nova] Creating event network-vif-plugged:5482f360-19f2-4834-97b3-e0b92e4ad931 for instance 89ff25cf-fceb-4cf3-b346-e7c9292e92a9 on hv-cinder-85083 Aug 03 10:56:16.390307 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-d44dfccc-ee2f-4532-89c7-4e32bc582f8b req-03985a51-1c27-42e8-80c2-01092e69658f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095921 Aug 03 10:56:16.390939 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 526/1072] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:56:17.208256 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-892f6e63-ebd6-4c9b-b9db-75549851f57d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:17.208896 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-892f6e63-ebd6-4c9b-b9db-75549851f57d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:17.215504 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-892f6e63-ebd6-4c9b-b9db-75549851f57d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:17.215955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-892f6e63-ebd6-4c9b-b9db-75549851f57d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:17.216739 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-892f6e63-ebd6-4c9b-b9db-75549851f57d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:17.217167 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-892f6e63-ebd6-4c9b-b9db-75549851f57d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:17.362735 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-892f6e63-ebd6-4c9b-b9db-75549851f57d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:17.371247 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-892f6e63-ebd6-4c9b-b9db-75549851f57d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1264 microversion: 2.1 time: 0.166845 Aug 03 10:56:17.371820 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 547/1073] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:17 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:18.393773 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-cf88cfd1-0704-45c6-b3d2-eed4b0d941bb tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:18.394497 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-cf88cfd1-0704-45c6-b3d2-eed4b0d941bb tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:18.401104 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cf88cfd1-0704-45c6-b3d2-eed4b0d941bb tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:18.401583 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cf88cfd1-0704-45c6-b3d2-eed4b0d941bb tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:18.402361 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cf88cfd1-0704-45c6-b3d2-eed4b0d941bb tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:18.402884 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-cf88cfd1-0704-45c6-b3d2-eed4b0d941bb tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:18.542893 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-cf88cfd1-0704-45c6-b3d2-eed4b0d941bb tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:18.550384 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-cf88cfd1-0704-45c6-b3d2-eed4b0d941bb tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1450 microversion: 2.1 time: 0.161532 Aug 03 10:56:18.550952 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 527/1074] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:18 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:18.571421 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-28535320-5410-40cd-8796-cf6263be5818 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:56:18.572083 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-28535320-5410-40cd-8796-cf6263be5818 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:56:18.578779 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-28535320-5410-40cd-8796-cf6263be5818 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:18.579228 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-28535320-5410-40cd-8796-cf6263be5818 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:18.580005 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-28535320-5410-40cd-8796-cf6263be5818 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:18.580438 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-28535320-5410-40cd-8796-cf6263be5818 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:18.720022 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-28535320-5410-40cd-8796-cf6263be5818 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:56:18.728145 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-28535320-5410-40cd-8796-cf6263be5818 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1450 microversion: 2.1 time: 0.160982 Aug 03 10:56:18.728705 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 548/1075] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:56:18 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:56:20.532913 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-5be47942-a900-4e58-9143-0072c4b6135a req-ca321bee-2778-4927-9e83-7d5d8f779a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ff25cf-fceb-4cf3-b346-e7c9292e92a9", "tag": "5482f360-19f2-4834-97b3-e0b92e4ad931"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:56:20.543429 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-5be47942-a900-4e58-9143-0072c4b6135a req-ca321bee-2778-4927-9e83-7d5d8f779a66 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:56:20.543977 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-5be47942-a900-4e58-9143-0072c4b6135a req-ca321bee-2778-4927-9e83-7d5d8f779a66 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:56:20.557966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-5be47942-a900-4e58-9143-0072c4b6135a req-ca321bee-2778-4927-9e83-7d5d8f779a66 service nova] Creating event network-changed:5482f360-19f2-4834-97b3-e0b92e4ad931 for instance 89ff25cf-fceb-4cf3-b346-e7c9292e92a9 on hv-cinder-85083 Aug 03 10:56:20.563400 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-5be47942-a900-4e58-9143-0072c4b6135a req-ca321bee-2778-4927-9e83-7d5d8f779a66 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034033 Aug 03 10:56:20.564113 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 528/1076] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:57:58.177460 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:57:58.178287 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=54 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:57:58.182297 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-764011450", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-25075408", "security_groups": [{"name": "tempest-secgroup-smoke-1904408597"}], "block_device_mapping_v2": [{"uuid": "2e26d502-ca14-42c9-bab6-7323d7998565", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6488fdc6-3ef0-410f-ba70-1b6189bea96e"}]}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:57:58.295767 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] validate_networks() for [('6488fdc6-3ef0-410f-ba70-1b6189bea96e', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:57:58.705218 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:57:58.705681 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:57:58.706151 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:57:58.706563 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:57:58.706974 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:57:58.716259 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:57:58.716711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:57:58.717533 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:57:58.717965 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:57:58.734971 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Getting quotas for project ad63d5a5bdb44dd6af0c25d524f38508. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:57:58.738898 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Getting quotas for user 7445b3f8940244c2abe1e3f1573bcd8a and project ad63d5a5bdb44dd6af0c25d524f38508. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:57:58.795818 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:57:58.797964 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e26d502-ca14-42c9-bab6-7323d7998565',volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:57:58.923723 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9513fb73-44c4-4c2a-8df4-b1859a431e02 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.747898 Aug 03 10:57:58.924353 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 549/1077] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 3 10:57:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:57:58.934609 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:57:58.935363 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:57:58.941220 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-7560230e-3308-4ebc-aa4c-7ec98e193278 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:57:58.941966 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-7560230e-3308-4ebc-aa4c-7ec98e193278 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:57:58.999555 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-7560230e-3308-4ebc-aa4c-7ec98e193278 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:57:59.006877 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-7560230e-3308-4ebc-aa4c-7ec98e193278 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1092 microversion: 2.1 time: 0.074929 Aug 03 10:57:59.007453 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 529/1078] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:57:58 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1092 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:58:00.029022 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ccf7f6a2-79e5-40bc-8eed-614b487d16a0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:58:00.029683 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ccf7f6a2-79e5-40bc-8eed-614b487d16a0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:58:00.036335 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ccf7f6a2-79e5-40bc-8eed-614b487d16a0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:00.036783 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ccf7f6a2-79e5-40bc-8eed-614b487d16a0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:00.037580 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ccf7f6a2-79e5-40bc-8eed-614b487d16a0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:00.038014 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ccf7f6a2-79e5-40bc-8eed-614b487d16a0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:00.105196 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ccf7f6a2-79e5-40bc-8eed-614b487d16a0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:58:00.113721 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ccf7f6a2-79e5-40bc-8eed-614b487d16a0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1208 microversion: 2.1 time: 0.089678 Aug 03 10:58:00.114289 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 550/1079] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:58:00 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1208 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:58:01.137187 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-e9f439fe-ba16-43aa-a790-349b9e958bfd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:58:01.137806 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-e9f439fe-ba16-43aa-a790-349b9e958bfd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:58:01.145493 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e9f439fe-ba16-43aa-a790-349b9e958bfd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:01.146018 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e9f439fe-ba16-43aa-a790-349b9e958bfd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:01.146878 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e9f439fe-ba16-43aa-a790-349b9e958bfd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:01.147477 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-e9f439fe-ba16-43aa-a790-349b9e958bfd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:01.293240 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-e9f439fe-ba16-43aa-a790-349b9e958bfd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:58:01.306921 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-e9f439fe-ba16-43aa-a790-349b9e958bfd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1264 microversion: 2.1 time: 0.175450 Aug 03 10:58:01.308008 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 530/1080] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:58:01 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:58:01.425447 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-72f1dce3-169a-406a-92e5-d036fd4a24de req-c51705aa-0d36-450d-8a41-713fecdc4946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d14fc06b-687e-454a-b514-2e34d19da823", "tag": "a20c6cdb-90de-44b3-80f5-a9e3517c7f08"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:58:01.435597 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-72f1dce3-169a-406a-92e5-d036fd4a24de req-c51705aa-0d36-450d-8a41-713fecdc4946 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:01.436043 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-72f1dce3-169a-406a-92e5-d036fd4a24de req-c51705aa-0d36-450d-8a41-713fecdc4946 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:01.447984 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-72f1dce3-169a-406a-92e5-d036fd4a24de req-c51705aa-0d36-450d-8a41-713fecdc4946 service nova] Creating event network-changed:a20c6cdb-90de-44b3-80f5-a9e3517c7f08 for instance d14fc06b-687e-454a-b514-2e34d19da823 on hv-cinder-85083 Aug 03 10:58:01.453879 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-72f1dce3-169a-406a-92e5-d036fd4a24de req-c51705aa-0d36-450d-8a41-713fecdc4946 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032784 Aug 03 10:58:01.454482 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 551/1081] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:58:02.328119 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ed8eb47d-cd25-483a-b64c-63108adacbcc tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:58:02.328703 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-ed8eb47d-cd25-483a-b64c-63108adacbcc tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:58:02.335103 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ed8eb47d-cd25-483a-b64c-63108adacbcc tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:02.335546 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ed8eb47d-cd25-483a-b64c-63108adacbcc tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:02.336302 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ed8eb47d-cd25-483a-b64c-63108adacbcc tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:02.336731 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ed8eb47d-cd25-483a-b64c-63108adacbcc tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:02.470330 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-ed8eb47d-cd25-483a-b64c-63108adacbcc tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:58:02.478624 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ed8eb47d-cd25-483a-b64c-63108adacbcc tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1264 microversion: 2.1 time: 0.154328 Aug 03 10:58:02.479183 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 531/1082] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:58:02 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:58:03.500158 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2609818a-977a-4927-be21-9b3b427e0ed0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:58:03.500891 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2609818a-977a-4927-be21-9b3b427e0ed0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:58:03.507198 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2609818a-977a-4927-be21-9b3b427e0ed0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:03.507647 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2609818a-977a-4927-be21-9b3b427e0ed0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:03.508409 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2609818a-977a-4927-be21-9b3b427e0ed0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:03.508842 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2609818a-977a-4927-be21-9b3b427e0ed0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:03.641948 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2609818a-977a-4927-be21-9b3b427e0ed0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:58:03.650012 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2609818a-977a-4927-be21-9b3b427e0ed0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1264 microversion: 2.1 time: 0.153711 Aug 03 10:58:03.650572 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 552/1083] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:58:03 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:58:04.671086 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-30913b66-ada0-453d-b2b1-d7a24b8cb2f3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:58:04.671690 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-30913b66-ada0-453d-b2b1-d7a24b8cb2f3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:58:04.678226 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-30913b66-ada0-453d-b2b1-d7a24b8cb2f3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:04.678669 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-30913b66-ada0-453d-b2b1-d7a24b8cb2f3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:04.679425 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-30913b66-ada0-453d-b2b1-d7a24b8cb2f3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:04.679860 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-30913b66-ada0-453d-b2b1-d7a24b8cb2f3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:04.808494 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-30913b66-ada0-453d-b2b1-d7a24b8cb2f3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:58:04.815877 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-30913b66-ada0-453d-b2b1-d7a24b8cb2f3 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1264 microversion: 2.1 time: 0.148762 Aug 03 10:58:04.816443 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 532/1084] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:58:04 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:58:05.835815 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-dd20353d-8cca-4873-8a79-6ce7ecdfe82a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:58:05.836429 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-dd20353d-8cca-4873-8a79-6ce7ecdfe82a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:58:05.845398 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dd20353d-8cca-4873-8a79-6ce7ecdfe82a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:05.845877 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dd20353d-8cca-4873-8a79-6ce7ecdfe82a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:05.846706 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dd20353d-8cca-4873-8a79-6ce7ecdfe82a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:05.847149 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dd20353d-8cca-4873-8a79-6ce7ecdfe82a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:05.977336 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-dd20353d-8cca-4873-8a79-6ce7ecdfe82a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:58:05.984822 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-dd20353d-8cca-4873-8a79-6ce7ecdfe82a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1264 microversion: 2.1 time: 0.152885 Aug 03 10:58:05.985379 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 553/1085] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:58:05 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:58:07.010909 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-9b4fd0eb-b7be-4d3e-a6e3-56534a779897 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:58:07.011540 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-9b4fd0eb-b7be-4d3e-a6e3-56534a779897 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:58:07.018214 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b4fd0eb-b7be-4d3e-a6e3-56534a779897 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:07.018663 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b4fd0eb-b7be-4d3e-a6e3-56534a779897 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:07.019435 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b4fd0eb-b7be-4d3e-a6e3-56534a779897 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:07.019870 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-9b4fd0eb-b7be-4d3e-a6e3-56534a779897 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:07.162272 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-9b4fd0eb-b7be-4d3e-a6e3-56534a779897 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:58:07.170509 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-9b4fd0eb-b7be-4d3e-a6e3-56534a779897 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1264 microversion: 2.1 time: 0.163650 Aug 03 10:58:07.171070 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 533/1086] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:58:07 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:58:08.190083 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-03750095-9d18-4263-a809-bb2cde62ab7c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:58:08.190750 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-03750095-9d18-4263-a809-bb2cde62ab7c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:58:08.197189 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-03750095-9d18-4263-a809-bb2cde62ab7c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:08.197676 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-03750095-9d18-4263-a809-bb2cde62ab7c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:08.198447 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-03750095-9d18-4263-a809-bb2cde62ab7c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:08.198882 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-03750095-9d18-4263-a809-bb2cde62ab7c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:08.327296 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-03750095-9d18-4263-a809-bb2cde62ab7c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:58:08.334819 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-03750095-9d18-4263-a809-bb2cde62ab7c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1264 microversion: 2.1 time: 0.148627 Aug 03 10:58:08.335368 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 554/1087] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:58:08 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:58:09.355480 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-5796fc85-54c3-4a06-9595-5479d0cb682d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:58:09.356086 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-5796fc85-54c3-4a06-9595-5479d0cb682d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:58:09.358441 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell0:SELECT=2 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:58:09.364069 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5796fc85-54c3-4a06-9595-5479d0cb682d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:09.364517 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5796fc85-54c3-4a06-9595-5479d0cb682d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:09.365279 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5796fc85-54c3-4a06-9595-5479d0cb682d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:09.365769 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-5796fc85-54c3-4a06-9595-5479d0cb682d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:09.499212 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-5796fc85-54c3-4a06-9595-5479d0cb682d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:58:09.506678 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-5796fc85-54c3-4a06-9595-5479d0cb682d tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1264 microversion: 2.1 time: 0.155019 Aug 03 10:58:09.507240 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 534/1088] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:58:09 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:58:10.527692 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-00c219fa-2828-458f-9283-d0191cdc36f5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:58:10.528261 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-00c219fa-2828-458f-9283-d0191cdc36f5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:58:10.530185 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:58:10.530843 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=6 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:58:10.536993 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-00c219fa-2828-458f-9283-d0191cdc36f5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:10.537448 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-00c219fa-2828-458f-9283-d0191cdc36f5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:10.538253 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-00c219fa-2828-458f-9283-d0191cdc36f5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:10.538695 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-00c219fa-2828-458f-9283-d0191cdc36f5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:10.669030 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-00c219fa-2828-458f-9283-d0191cdc36f5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:58:10.676497 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-00c219fa-2828-458f-9283-d0191cdc36f5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1264 microversion: 2.1 time: 0.153331 Aug 03 10:58:10.677063 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 555/1089] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:58:10 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:58:11.697143 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4781cac1-546f-470d-8c64-d5c3e056bbd9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:58:11.697783 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4781cac1-546f-470d-8c64-d5c3e056bbd9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:58:11.704464 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4781cac1-546f-470d-8c64-d5c3e056bbd9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:11.704912 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4781cac1-546f-470d-8c64-d5c3e056bbd9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:11.705704 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4781cac1-546f-470d-8c64-d5c3e056bbd9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:11.706139 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4781cac1-546f-470d-8c64-d5c3e056bbd9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:11.836652 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-4781cac1-546f-470d-8c64-d5c3e056bbd9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:58:11.844656 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-4781cac1-546f-470d-8c64-d5c3e056bbd9 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1264 microversion: 2.1 time: 0.151493 Aug 03 10:58:11.845216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 535/1090] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:58:11 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:58:12.742552 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-9ebb8f90-f73a-4235-99c6-7c8b77d4eed4 req-90f298e6-03bd-44fd-8f61-e7568f5cd444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14fc06b-687e-454a-b514-2e34d19da823", "name": "network-vif-plugged", "status": "completed", "tag": "a20c6cdb-90de-44b3-80f5-a9e3517c7f08"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:58:12.753745 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-9ebb8f90-f73a-4235-99c6-7c8b77d4eed4 req-90f298e6-03bd-44fd-8f61-e7568f5cd444 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:12.754257 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-9ebb8f90-f73a-4235-99c6-7c8b77d4eed4 req-90f298e6-03bd-44fd-8f61-e7568f5cd444 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:12.765867 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-9ebb8f90-f73a-4235-99c6-7c8b77d4eed4 req-90f298e6-03bd-44fd-8f61-e7568f5cd444 service nova] Creating event network-vif-plugged:a20c6cdb-90de-44b3-80f5-a9e3517c7f08 for instance d14fc06b-687e-454a-b514-2e34d19da823 on hv-cinder-85083 Aug 03 10:58:12.770964 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-9ebb8f90-f73a-4235-99c6-7c8b77d4eed4 req-90f298e6-03bd-44fd-8f61-e7568f5cd444 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032121 Aug 03 10:58:12.771551 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 556/1091] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:58:12.867862 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-1dd3335f-dc22-4860-af27-957b256210df tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:58:12.869276 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-1dd3335f-dc22-4860-af27-957b256210df tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:58:12.875828 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1dd3335f-dc22-4860-af27-957b256210df tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:12.876315 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1dd3335f-dc22-4860-af27-957b256210df tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:12.877097 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1dd3335f-dc22-4860-af27-957b256210df tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:12.877521 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-1dd3335f-dc22-4860-af27-957b256210df tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:13.014081 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-1dd3335f-dc22-4860-af27-957b256210df tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:58:13.025773 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-1dd3335f-dc22-4860-af27-957b256210df tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1264 microversion: 2.1 time: 0.160740 Aug 03 10:58:13.026635 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 536/1092] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:58:12 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:58:14.050565 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-20437ea5-3089-4207-9d2d-8fe5dd1526ee tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:58:14.051292 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-20437ea5-3089-4207-9d2d-8fe5dd1526ee tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:58:14.058062 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-20437ea5-3089-4207-9d2d-8fe5dd1526ee tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:14.058514 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-20437ea5-3089-4207-9d2d-8fe5dd1526ee tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:14.059281 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-20437ea5-3089-4207-9d2d-8fe5dd1526ee tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:14.059719 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-20437ea5-3089-4207-9d2d-8fe5dd1526ee tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:14.188742 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-20437ea5-3089-4207-9d2d-8fe5dd1526ee tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:58:14.196599 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-20437ea5-3089-4207-9d2d-8fe5dd1526ee tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1264 microversion: 2.1 time: 0.150717 Aug 03 10:58:14.197213 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 557/1093] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:58:14 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:58:15.217403 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-ea977dc8-eeb0-4320-84e4-011e9288228e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:58:15.218028 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-ea977dc8-eeb0-4320-84e4-011e9288228e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:58:15.224561 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ea977dc8-eeb0-4320-84e4-011e9288228e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:15.225003 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ea977dc8-eeb0-4320-84e4-011e9288228e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:15.225793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ea977dc8-eeb0-4320-84e4-011e9288228e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:15.226216 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-ea977dc8-eeb0-4320-84e4-011e9288228e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:15.357519 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-ea977dc8-eeb0-4320-84e4-011e9288228e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:58:15.364920 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-ea977dc8-eeb0-4320-84e4-011e9288228e tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1451 microversion: 2.1 time: 0.152150 Aug 03 10:58:15.365512 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 537/1094] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:58:15 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:58:15.391933 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-55627056-4317-45ca-892f-9210dbd9da8c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:58:15.392542 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-55627056-4317-45ca-892f-9210dbd9da8c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:58:15.399967 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-55627056-4317-45ca-892f-9210dbd9da8c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:15.400633 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-55627056-4317-45ca-892f-9210dbd9da8c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:15.402161 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-55627056-4317-45ca-892f-9210dbd9da8c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:15.402818 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-55627056-4317-45ca-892f-9210dbd9da8c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:15.531759 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-55627056-4317-45ca-892f-9210dbd9da8c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:58:15.539263 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-55627056-4317-45ca-892f-9210dbd9da8c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1451 microversion: 2.1 time: 0.157572 Aug 03 10:58:15.539825 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 558/1095] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:58:15 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:58:17.428107 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-3b2d3a9a-2734-482b-89f9-70e0abb6c2a5 req-af83106c-e5a1-4bb6-b0c3-510ddae60527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d14fc06b-687e-454a-b514-2e34d19da823", "tag": "a20c6cdb-90de-44b3-80f5-a9e3517c7f08"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:58:17.437974 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-3b2d3a9a-2734-482b-89f9-70e0abb6c2a5 req-af83106c-e5a1-4bb6-b0c3-510ddae60527 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:58:17.438506 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-3b2d3a9a-2734-482b-89f9-70e0abb6c2a5 req-af83106c-e5a1-4bb6-b0c3-510ddae60527 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:58:17.454945 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-3b2d3a9a-2734-482b-89f9-70e0abb6c2a5 req-af83106c-e5a1-4bb6-b0c3-510ddae60527 service nova] Creating event network-changed:a20c6cdb-90de-44b3-80f5-a9e3517c7f08 for instance d14fc06b-687e-454a-b514-2e34d19da823 on hv-cinder-85083 Aug 03 10:58:17.460295 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-3b2d3a9a-2734-482b-89f9-70e0abb6c2a5 req-af83106c-e5a1-4bb6-b0c3-510ddae60527 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105901 Aug 03 10:58:17.461045 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 538/1096] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:58:50.610658 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:58:50.611277 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Wed Aug 3 10:58:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:58:54.935400 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:58:54.935931 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Wed Aug 3 10:58:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:59:06.580955 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:59:06.581715 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Wed Aug 3 10:59:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:59:45.190920 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:59:45.191872 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=48 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:59:45.195632 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_api:SELECT=22 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:59:45.196520 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG dbcounter [-] [124389] Writing DB stats nova_cell1:SELECT=50 {{(pid=124389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:59:45.202323 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-633688e2-8a2e-4341-a3fb-0e0cd69ef97f tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:59:45.202323 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-633688e2-8a2e-4341-a3fb-0e0cd69ef97f tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:59:45.208300 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-dc649887-0d88-4f7a-b4ef-f314b0bbc871 req-3ebc75d0-fd55-4703-aa3f-85f320f1b0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d14fc06b-687e-454a-b514-2e34d19da823", "tag": "a20c6cdb-90de-44b3-80f5-a9e3517c7f08"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:59:45.210772 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-633688e2-8a2e-4341-a3fb-0e0cd69ef97f tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:45.211262 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-633688e2-8a2e-4341-a3fb-0e0cd69ef97f tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:45.212057 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-633688e2-8a2e-4341-a3fb-0e0cd69ef97f tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:45.212489 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-633688e2-8a2e-4341-a3fb-0e0cd69ef97f tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:45.222739 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-dc649887-0d88-4f7a-b4ef-f314b0bbc871 req-3ebc75d0-fd55-4703-aa3f-85f320f1b0d2 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:45.223178 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-dc649887-0d88-4f7a-b4ef-f314b0bbc871 req-3ebc75d0-fd55-4703-aa3f-85f320f1b0d2 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:45.236138 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-dc649887-0d88-4f7a-b4ef-f314b0bbc871 req-3ebc75d0-fd55-4703-aa3f-85f320f1b0d2 service nova] Creating event network-changed:a20c6cdb-90de-44b3-80f5-a9e3517c7f08 for instance d14fc06b-687e-454a-b514-2e34d19da823 on hv-cinder-85083 Aug 03 10:59:45.241760 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-dc649887-0d88-4f7a-b4ef-f314b0bbc871 req-3ebc75d0-fd55-4703-aa3f-85f320f1b0d2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052616 Aug 03 10:59:45.242652 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 539/1097] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:59:45.250875 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-633688e2-8a2e-4341-a3fb-0e0cd69ef97f tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:59:45.342956 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-633688e2-8a2e-4341-a3fb-0e0cd69ef97f tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 204 len: 0 microversion: 2.1 time: 0.155848 Aug 03 10:59:45.343860 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 559/1098] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:59:45 2022] DELETE /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:59:45.357597 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-18b56710-b512-4c8b-950a-f94739055bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:59:45.358956 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-18b56710-b512-4c8b-950a-f94739055bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:59:45.367489 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-18b56710-b512-4c8b-950a-f94739055bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:45.368304 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-18b56710-b512-4c8b-950a-f94739055bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:45.369579 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-18b56710-b512-4c8b-950a-f94739055bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:45.370036 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-18b56710-b512-4c8b-950a-f94739055bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:45.570416 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-18b56710-b512-4c8b-950a-f94739055bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:59:45.578236 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-18b56710-b512-4c8b-950a-f94739055bc4 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1576 microversion: 2.1 time: 0.229174 Aug 03 10:59:45.579450 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 540/1099] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:59:45 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1576 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:59:46.601687 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e6966e32-0e89-406c-8370-0a323f546b58 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:59:46.602400 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e6966e32-0e89-406c-8370-0a323f546b58 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:59:46.609101 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e6966e32-0e89-406c-8370-0a323f546b58 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:46.609582 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e6966e32-0e89-406c-8370-0a323f546b58 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:46.611063 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e6966e32-0e89-406c-8370-0a323f546b58 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:46.611645 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e6966e32-0e89-406c-8370-0a323f546b58 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:46.829806 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e6966e32-0e89-406c-8370-0a323f546b58 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:59:46.837955 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e6966e32-0e89-406c-8370-0a323f546b58 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1576 microversion: 2.1 time: 0.240729 Aug 03 10:59:46.838610 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 560/1100] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:59:46 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:59:47.408319 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-93493e45-4419-42b6-904c-31f702cba4b4 req-79a3fc65-6647-4cce-988d-fc7da562cfe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14fc06b-687e-454a-b514-2e34d19da823", "name": "network-vif-deleted", "tag": "a20c6cdb-90de-44b3-80f5-a9e3517c7f08"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:59:47.418374 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-93493e45-4419-42b6-904c-31f702cba4b4 req-79a3fc65-6647-4cce-988d-fc7da562cfe1 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:47.418824 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-93493e45-4419-42b6-904c-31f702cba4b4 req-79a3fc65-6647-4cce-988d-fc7da562cfe1 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:47.431312 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-93493e45-4419-42b6-904c-31f702cba4b4 req-79a3fc65-6647-4cce-988d-fc7da562cfe1 service nova] Creating event network-vif-deleted:a20c6cdb-90de-44b3-80f5-a9e3517c7f08 for instance d14fc06b-687e-454a-b514-2e34d19da823 on hv-cinder-85083 Aug 03 10:59:47.437037 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-93493e45-4419-42b6-904c-31f702cba4b4 req-79a3fc65-6647-4cce-988d-fc7da562cfe1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032448 Aug 03 10:59:47.437909 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 541/1101] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:59:47.859637 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-97c85f70-4be1-436d-98aa-9b8da9d082a2 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:59:47.860934 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-97c85f70-4be1-436d-98aa-9b8da9d082a2 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:59:47.867653 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-97c85f70-4be1-436d-98aa-9b8da9d082a2 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:47.868102 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-97c85f70-4be1-436d-98aa-9b8da9d082a2 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:47.868867 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-97c85f70-4be1-436d-98aa-9b8da9d082a2 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:47.869592 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-97c85f70-4be1-436d-98aa-9b8da9d082a2 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:47.899781 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-97c85f70-4be1-436d-98aa-9b8da9d082a2 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:47.900231 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-97c85f70-4be1-436d-98aa-9b8da9d082a2 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:47.903408 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-97c85f70-4be1-436d-98aa-9b8da9d082a2 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lazy-loading 'fault' on Instance uuid d14fc06b-687e-454a-b514-2e34d19da823 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:59:47.942357 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-97c85f70-4be1-436d-98aa-9b8da9d082a2 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:59:47.949993 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-97c85f70-4be1-436d-98aa-9b8da9d082a2 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 200 len: 1228 microversion: 2.1 time: 0.094181 Aug 03 10:59:47.950573 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 561/1102] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:59:47 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:59:48.972065 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2e1b8b4d-9570-4861-bf1e-8f2afd8dee46 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:59:48.972759 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-2e1b8b4d-9570-4861-bf1e-8f2afd8dee46 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: d14fc06b-687e-454a-b514-2e34d19da823] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:59:48.978938 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2e1b8b4d-9570-4861-bf1e-8f2afd8dee46 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:48.979382 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2e1b8b4d-9570-4861-bf1e-8f2afd8dee46 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:48.980135 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2e1b8b4d-9570-4861-bf1e-8f2afd8dee46 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:48.980564 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-2e1b8b4d-9570-4861-bf1e-8f2afd8dee46 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:48.994498 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-2e1b8b4d-9570-4861-bf1e-8f2afd8dee46 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] HTTP exception thrown: Instance d14fc06b-687e-454a-b514-2e34d19da823 could not be found. Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2e1b8b4d-9570-4861-bf1e-8f2afd8dee46 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Request method failure captured: Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 HTTP/1.1 Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lOl5B4Usw5JETIYdtv4p8aPgT50_IJLXd2xMOr8uy3nOD6UkzFyNg3zLQOndleUv4_hngbNTnAl-ygbb_CiJ8_5-XjCQPKKSVAnx6KzuJ76ZrxcnvCpY8WqpO87fmByppgL32Unr65npMfqaaHErUWNpopXmV6BxT1deifMFJR8Oz8 Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: ad63d5a5bdb44dd6af0c25d524f38508 Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-TestVolumeBootPattern-1712361144 Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:59:48.996092 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:59:48.997831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad63d5a5bdb44dd6af0c25d524f38508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ad63d5a5bdb44dd6af0c25d524f38508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad63d5a5bdb44dd6af0c25d524f38508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ad63d5a5bdb44dd6af0c25d524f38508", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:59:48.997831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-TestVolumeBootPattern-1712361144 Aug 03 10:59:48.997831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: ad63d5a5bdb44dd6af0c25d524f38508 Aug 03 10:59:48.997831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-TestVolumeBootPattern-1712361144 Aug 03 10:59:48.997831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-TestVolumeBootPattern-1712361144-project Aug 03 10:59:48.997831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:59:48.997831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:59:48.997831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 7445b3f8940244c2abe1e3f1573bcd8a Aug 03 10:59:48.997831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-TestVolumeBootPattern-1712361144-project Aug 03 10:59:48.997831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:59:48.997831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance d14fc06b-687e-454a-b514-2e34d19da823 could not be found. Aug 03 10:59:48.997831 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': 'd14fc06b-687e-454a-b514-2e34d19da823'} Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d14fc06b-687e-454a-b514-2e34d19da823 could not be found. Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:59:48.998793 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d14fc06b-687e-454a-b514-2e34d19da823 could not be found. Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d14fc06b-687e-454a-b514-2e34d19da823 could not be found. Aug 03 10:59:49.000993 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:59:49.002574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-2e1b8b4d-9570-4861-bf1e-8f2afd8dee46 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Returning 404 to user: Instance d14fc06b-687e-454a-b514-2e34d19da823 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:59:49.002574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-2e1b8b4d-9570-4861-bf1e-8f2afd8dee46 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823" status: 404 len: 111 microversion: 2.1 time: 0.030124 Aug 03 10:59:49.002574 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 542/1103] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:59:48 2022] GET /compute/v2.1/servers/d14fc06b-687e-454a-b514-2e34d19da823 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:59:52.055710 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0cc39f46-65fc-439e-a50c-696687d5418a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:59:52.056331 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0cc39f46-65fc-439e-a50c-696687d5418a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:59:52.059089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-3d89de01-b2cc-4721-88f4-83b5dfb2965c req-2cf70701-02e6-42e3-9324-57412bc9bd87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ff25cf-fceb-4cf3-b346-e7c9292e92a9", "tag": "5482f360-19f2-4834-97b3-e0b92e4ad931"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:59:52.064212 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0cc39f46-65fc-439e-a50c-696687d5418a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:52.064673 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0cc39f46-65fc-439e-a50c-696687d5418a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:52.065494 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0cc39f46-65fc-439e-a50c-696687d5418a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:52.065971 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0cc39f46-65fc-439e-a50c-696687d5418a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:52.071367 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-3d89de01-b2cc-4721-88f4-83b5dfb2965c req-2cf70701-02e6-42e3-9324-57412bc9bd87 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:52.071824 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-3d89de01-b2cc-4721-88f4-83b5dfb2965c req-2cf70701-02e6-42e3-9324-57412bc9bd87 service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:52.084992 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-3d89de01-b2cc-4721-88f4-83b5dfb2965c req-2cf70701-02e6-42e3-9324-57412bc9bd87 service nova] Creating event network-changed:5482f360-19f2-4834-97b3-e0b92e4ad931 for instance 89ff25cf-fceb-4cf3-b346-e7c9292e92a9 on hv-cinder-85083 Aug 03 10:59:52.090918 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-3d89de01-b2cc-4721-88f4-83b5dfb2965c req-2cf70701-02e6-42e3-9324-57412bc9bd87 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035377 Aug 03 10:59:52.092179 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 543/1104] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:59:52.095355 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0cc39f46-65fc-439e-a50c-696687d5418a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:59:52.206906 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0cc39f46-65fc-439e-a50c-696687d5418a tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "DELETE /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 204 len: 0 microversion: 2.1 time: 0.154923 Aug 03 10:59:52.208081 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 562/1105] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:59:52 2022] DELETE /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:59:52.218944 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-99fee063-e99d-4c2f-be50-c630cf7b05e0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:59:52.220327 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-99fee063-e99d-4c2f-be50-c630cf7b05e0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:59:52.228465 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-99fee063-e99d-4c2f-be50-c630cf7b05e0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:52.229390 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-99fee063-e99d-4c2f-be50-c630cf7b05e0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:52.230436 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-99fee063-e99d-4c2f-be50-c630cf7b05e0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:52.232259 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-99fee063-e99d-4c2f-be50-c630cf7b05e0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:52.392544 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.policy [None req-99fee063-e99d-4c2f-be50-c630cf7b05e0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124389) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:59:52.400448 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-99fee063-e99d-4c2f-be50-c630cf7b05e0 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1575 microversion: 2.1 time: 0.188002 Aug 03 10:59:52.401033 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 544/1106] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:59:52 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:59:53.423616 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fc2e8501-8eb1-4fc1-b2e5-4a9f37600c1c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:59:53.424323 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fc2e8501-8eb1-4fc1-b2e5-4a9f37600c1c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:59:53.431022 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fc2e8501-8eb1-4fc1-b2e5-4a9f37600c1c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:53.431398 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fc2e8501-8eb1-4fc1-b2e5-4a9f37600c1c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:53.432193 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fc2e8501-8eb1-4fc1-b2e5-4a9f37600c1c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:53.432680 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fc2e8501-8eb1-4fc1-b2e5-4a9f37600c1c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:53.580107 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-fc2e8501-8eb1-4fc1-b2e5-4a9f37600c1c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:59:53.588042 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fc2e8501-8eb1-4fc1-b2e5-4a9f37600c1c tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1575 microversion: 2.1 time: 0.168630 Aug 03 10:59:53.588636 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 563/1107] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:59:53 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:59:54.122123 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [req-22a07719-9355-4b6f-9fc2-6fb2e7dd6376 req-a7bc11a1-1960-447a-b654-0d6ec7f39d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ff25cf-fceb-4cf3-b346-e7c9292e92a9", "name": "network-vif-deleted", "tag": "5482f360-19f2-4834-97b3-e0b92e4ad931"}]} {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:59:54.136529 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-22a07719-9355-4b6f-9fc2-6fb2e7dd6376 req-a7bc11a1-1960-447a-b654-0d6ec7f39d9c service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:54.136970 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [req-22a07719-9355-4b6f-9fc2-6fb2e7dd6376 req-a7bc11a1-1960-447a-b654-0d6ec7f39d9c service nova] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:54.152741 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.compute.server_external_events [req-22a07719-9355-4b6f-9fc2-6fb2e7dd6376 req-a7bc11a1-1960-447a-b654-0d6ec7f39d9c service nova] Creating event network-vif-deleted:5482f360-19f2-4834-97b3-e0b92e4ad931 for instance 89ff25cf-fceb-4cf3-b346-e7c9292e92a9 on hv-cinder-85083 Aug 03 10:59:54.158477 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [req-22a07719-9355-4b6f-9fc2-6fb2e7dd6376 req-a7bc11a1-1960-447a-b654-0d6ec7f39d9c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041169 Aug 03 10:59:54.159077 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 545/1108] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 3 10:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:59:54.610625 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bee5acc9-d333-4da5-bf56-44bcb623b966 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:59:54.611172 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bee5acc9-d333-4da5-bf56-44bcb623b966 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:59:54.617849 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bee5acc9-d333-4da5-bf56-44bcb623b966 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:54.618338 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bee5acc9-d333-4da5-bf56-44bcb623b966 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:54.619494 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bee5acc9-d333-4da5-bf56-44bcb623b966 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:54.619816 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bee5acc9-d333-4da5-bf56-44bcb623b966 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:54.653853 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bee5acc9-d333-4da5-bf56-44bcb623b966 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:54.654229 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bee5acc9-d333-4da5-bf56-44bcb623b966 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:54.654711 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-bee5acc9-d333-4da5-bf56-44bcb623b966 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lazy-loading 'fault' on Instance uuid 89ff25cf-fceb-4cf3-b346-e7c9292e92a9 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:59:54.702417 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bee5acc9-d333-4da5-bf56-44bcb623b966 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7445b3f8940244c2abe1e3f1573bcd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad63d5a5bdb44dd6af0c25d524f38508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:59:54.710080 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bee5acc9-d333-4da5-bf56-44bcb623b966 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 200 len: 1228 microversion: 2.1 time: 0.104146 Aug 03 10:59:54.710658 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 564/1109] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:59:54 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 1228 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:59:55.732309 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4e2f139a-5c42-46bd-a052-76f6bce649cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:59:55.732838 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-4e2f139a-5c42-46bd-a052-76f6bce649cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: 89ff25cf-fceb-4cf3-b346-e7c9292e92a9] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:59:55.740264 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4e2f139a-5c42-46bd-a052-76f6bce649cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:55.740708 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4e2f139a-5c42-46bd-a052-76f6bce649cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:55.741515 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4e2f139a-5c42-46bd-a052-76f6bce649cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:55.741948 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-4e2f139a-5c42-46bd-a052-76f6bce649cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:55.756074 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-4e2f139a-5c42-46bd-a052-76f6bce649cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] HTTP exception thrown: Instance 89ff25cf-fceb-4cf3-b346-e7c9292e92a9 could not be found. Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4e2f139a-5c42-46bd-a052-76f6bce649cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Request method failure captured: Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 HTTP/1.1 Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lOl5B4Usw5JETIYdtv4p8aPgT50_IJLXd2xMOr8uy3nOD6UkzFyNg3zLQOndleUv4_hngbNTnAl-ygbb_CiJ8_5-XjCQPKKSVAnx6KzuJ76ZrxcnvCpY8WqpO87fmByppgL32Unr65npMfqaaHErUWNpopXmV6BxT1deifMFJR8Oz8 Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: ad63d5a5bdb44dd6af0c25d524f38508 Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-TestVolumeBootPattern-1712361144 Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:59:55.757725 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:59:55.759345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad63d5a5bdb44dd6af0c25d524f38508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ad63d5a5bdb44dd6af0c25d524f38508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad63d5a5bdb44dd6af0c25d524f38508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ad63d5a5bdb44dd6af0c25d524f38508", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:59:55.759345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-TestVolumeBootPattern-1712361144 Aug 03 10:59:55.759345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: ad63d5a5bdb44dd6af0c25d524f38508 Aug 03 10:59:55.759345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-TestVolumeBootPattern-1712361144 Aug 03 10:59:55.759345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-TestVolumeBootPattern-1712361144-project Aug 03 10:59:55.759345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:59:55.759345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:59:55.759345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 7445b3f8940244c2abe1e3f1573bcd8a Aug 03 10:59:55.759345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-TestVolumeBootPattern-1712361144-project Aug 03 10:59:55.759345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:59:55.759345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance 89ff25cf-fceb-4cf3-b346-e7c9292e92a9 could not be found. Aug 03 10:59:55.759345 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': '89ff25cf-fceb-4cf3-b346-e7c9292e92a9'} Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89ff25cf-fceb-4cf3-b346-e7c9292e92a9 could not be found. Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:59:55.760275 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89ff25cf-fceb-4cf3-b346-e7c9292e92a9 could not be found. Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89ff25cf-fceb-4cf3-b346-e7c9292e92a9 could not be found. Aug 03 10:59:55.761896 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:59:55.763273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-4e2f139a-5c42-46bd-a052-76f6bce649cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Returning 404 to user: Instance 89ff25cf-fceb-4cf3-b346-e7c9292e92a9 could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:59:55.763273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-4e2f139a-5c42-46bd-a052-76f6bce649cd tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9" status: 404 len: 111 microversion: 2.1 time: 0.031282 Aug 03 10:59:55.763273 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 546/1110] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:59:55 2022] GET /compute/v2.1/servers/89ff25cf-fceb-4cf3-b346-e7c9292e92a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:59:56.196853 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3be91e9b-a7fd-44b1-a39d-f5263165dbd5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:59:56.197405 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3be91e9b-a7fd-44b1-a39d-f5263165dbd5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:59:56.204121 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3be91e9b-a7fd-44b1-a39d-f5263165dbd5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:56.204573 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3be91e9b-a7fd-44b1-a39d-f5263165dbd5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:56.205348 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3be91e9b-a7fd-44b1-a39d-f5263165dbd5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:56.205823 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3be91e9b-a7fd-44b1-a39d-f5263165dbd5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:56.220164 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-3be91e9b-a7fd-44b1-a39d-f5263165dbd5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] HTTP exception thrown: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3be91e9b-a7fd-44b1-a39d-f5263165dbd5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Request method failure captured: Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: request: DELETE /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d HTTP/1.1 Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept: application/json Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Connection: close Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Length: 0 Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Content-Type: application/json Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Host: 10.222.0.47 Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.10 Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi6lOl5B4Usw5JETIYdtv4p8aPgT50_IJLXd2xMOr8uy3nOD6UkzFyNg3zLQOndleUv4_hngbNTnAl-ygbb_CiJ8_5-XjCQPKKSVAnx6KzuJ76ZrxcnvCpY8WqpO87fmByppgL32Unr65npMfqaaHErUWNpopXmV6BxT1deifMFJR8Oz8 Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Id: ad63d5a5bdb44dd6af0c25d524f38508 Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-TestVolumeBootPattern-1712361144 Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Role: member,reader Aug 03 10:59:56.221907 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Roles: member,reader Aug 03 10:59:56.223478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad63d5a5bdb44dd6af0c25d524f38508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ad63d5a5bdb44dd6af0c25d524f38508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad63d5a5bdb44dd6af0c25d524f38508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ad63d5a5bdb44dd6af0c25d524f38508", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:59:56.223478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-TestVolumeBootPattern-1712361144 Aug 03 10:59:56.223478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Id: ad63d5a5bdb44dd6af0c25d524f38508 Aug 03 10:59:56.223478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-TestVolumeBootPattern-1712361144 Aug 03 10:59:56.223478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User: tempest-TestVolumeBootPattern-1712361144-project Aug 03 10:59:56.223478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Aug 03 10:59:56.223478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Aug 03 10:59:56.223478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Id: 7445b3f8940244c2abe1e3f1573bcd8a Aug 03 10:59:56.223478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-TestVolumeBootPattern-1712361144-project Aug 03 10:59:56.223478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: method: > Aug 03 10:59:56.223478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: exception: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. Aug 03 10:59:56.223478 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: action_args: {'id': 'b7080ee4-892a-4b29-99cf-2b3907ed9b9d'} Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:59:56.224391 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. Aug 03 10:59:56.225880 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Aug 03 10:59:56.227457 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3be91e9b-a7fd-44b1-a39d-f5263165dbd5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Returning 404 to user: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:59:56.227457 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3be91e9b-a7fd-44b1-a39d-f5263165dbd5 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 404 len: 111 microversion: 2.1 time: 0.031116 Aug 03 10:59:56.227457 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 565/1111] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 3 10:59:56 2022] DELETE /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:59:56.232418 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-291559c6-7d5a-4b12-9ed1-4771920494a6 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '>' {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:59:56.233029 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.compute.api [None req-291559c6-7d5a-4b12-9ed1-4771920494a6 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] [instance: b7080ee4-892a-4b29-99cf-2b3907ed9b9d] Fetching instance by UUID {{(pid=124389) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:59:56.239864 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-291559c6-7d5a-4b12-9ed1-4771920494a6 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:56.240307 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-291559c6-7d5a-4b12-9ed1-4771920494a6 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:56.241070 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-291559c6-7d5a-4b12-9ed1-4771920494a6 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:59:56.241518 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG oslo_concurrency.lockutils [None req-291559c6-7d5a-4b12-9ed1-4771920494a6 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Lock "4d171320-82a2-402f-aa25-567d87407a2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:59:56.255845 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.wsgi [None req-291559c6-7d5a-4b12-9ed1-4771920494a6 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] HTTP exception thrown: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-291559c6-7d5a-4b12-9ed1-4771920494a6 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Request method failure captured: Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: request: GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d HTTP/1.1 Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept: application/json Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Accept-Encoding: identity Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Connection: close Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Length: 0 Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Content-Type: application/json Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Host: 10.222.0.47 Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Openstack-System-Scope: None Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: User-Agent: python-urllib3/1.26.10 Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Auth-Token: gAAAAABi6lOl5B4Usw5JETIYdtv4p8aPgT50_IJLXd2xMOr8uy3nOD6UkzFyNg3zLQOndleUv4_hngbNTnAl-ygbb_CiJ8_5-XjCQPKKSVAnx6KzuJ76ZrxcnvCpY8WqpO87fmByppgL32Unr65npMfqaaHErUWNpopXmV6BxT1deifMFJR8Oz8 Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Id: None Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Domain-Name: None Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Identity-Status: Confirmed Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Is-Admin-Project: True Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Id: default Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Domain-Name: Default Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Id: ad63d5a5bdb44dd6af0c25d524f38508 Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Project-Name: tempest-TestVolumeBootPattern-1712361144 Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Role: member,reader Aug 03 10:59:56.257373 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Roles: member,reader Aug 03 10:59:56.259089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad63d5a5bdb44dd6af0c25d524f38508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ad63d5a5bdb44dd6af0c25d524f38508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad63d5a5bdb44dd6af0c25d524f38508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ad63d5a5bdb44dd6af0c25d524f38508", "adminURL": "http://10.222.0.47:8080"}]}] Aug 03 10:59:56.259089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant: tempest-TestVolumeBootPattern-1712361144 Aug 03 10:59:56.259089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Id: ad63d5a5bdb44dd6af0c25d524f38508 Aug 03 10:59:56.259089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-Tenant-Name: tempest-TestVolumeBootPattern-1712361144 Aug 03 10:59:56.259089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User: tempest-TestVolumeBootPattern-1712361144-project Aug 03 10:59:56.259089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Id: default Aug 03 10:59:56.259089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Domain-Name: Default Aug 03 10:59:56.259089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Id: 7445b3f8940244c2abe1e3f1573bcd8a Aug 03 10:59:56.259089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: X-User-Name: tempest-TestVolumeBootPattern-1712361144-project Aug 03 10:59:56.259089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: method: > Aug 03 10:59:56.259089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: exception: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. Aug 03 10:59:56.259089 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: action_args: {'id': 'b7080ee4-892a-4b29-99cf-2b3907ed9b9d'} Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: {{(pid=124389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:59:56.263170 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. Aug 03 10:59:56.264753 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: ERROR nova.api.openstack.wsgi Aug 03 10:59:56.267020 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: DEBUG nova.api.openstack.wsgi [None req-291559c6-7d5a-4b12-9ed1-4771920494a6 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Returning 404 to user: Instance b7080ee4-892a-4b29-99cf-2b3907ed9b9d could not be found. {{(pid=124389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:59:56.267020 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO nova.api.openstack.requestlog [None req-291559c6-7d5a-4b12-9ed1-4771920494a6 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d" status: 404 len: 111 microversion: 2.1 time: 0.030309 Aug 03 10:59:56.267020 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: [pid: 124389|app: 0|req: 547/1112] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 3 10:59:56 2022] GET /compute/v2.1/servers/b7080ee4-892a-4b29-99cf-2b3907ed9b9d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:59:57.575186 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-166f8dcc-03d7-4c8a-859c-4416d9a5e789 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] Calling method '.version_select at 0x7fbd1060b1f0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:59:57.600806 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-166f8dcc-03d7-4c8a-859c-4416d9a5e789 tempest-TestVolumeBootPattern-1712361144 tempest-TestVolumeBootPattern-1712361144-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-25075408" status: 202 len: 0 microversion: 2.1 time: 0.029406 Aug 03 10:59:57.604631 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 566/1113] 10.222.0.47 () {58 vars in 1257 bytes} [Wed Aug 3 10:59:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-25075408 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 11:00:47.078781 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 11:00:47.079972 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Wed Aug 3 11:00:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 11:02:14.944576 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 11:02:14.945307 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Wed Aug 3 11:02:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 11:02:26.589556 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 11:02:26.590329 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Wed Aug 3 11:02:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 11:02:54.499498 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 11:02:54.500244 dv-cinder-850836-2-iscsi devstack@n-api.service[124389]: Wed Aug 3 11:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 11:03:11.569742 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 11:03:11.570295 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Wed Aug 3 11:03:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 11:04:07.091453 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 11:04:07.092086 dv-cinder-850836-2-iscsi devstack@n-api.service[124388]: Wed Aug 3 11:04:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!